[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:44:56 dist-test-slave-vkjp krb5kdc[21464](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:44:56 dist-test-slave-vkjp krb5kdc[21464](info): set up 2 sockets
Aug 11 11:44:56 dist-test-slave-vkjp krb5kdc[21464](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 11:44:57.922750 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.155s user 0.006s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:44:58 dist-test-slave-vkjp krb5kdc[21464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448698, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:44:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:44:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:44:58.063298 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:43451
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:39975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:43451
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:44:58.190752 21481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:44:58.191053 21481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:44:58.191166 21481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:44:58.195168 21481 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:44:58.195248 21481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:44:58.195300 21481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:44:58.195358 21481 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:44:58.195394 21481 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:44:58.200853 21481 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:39975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:43451
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:43451
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21481
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:44:58.202303 21481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:44:58.203616 21481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:44:58.216626 21481 server_base.cc:1034] running on GCE node
W20260811 11:44:58.216632 21487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:44:58.217223 21486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:44:58.217550 21490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:44:58.218338 21481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:44:58.220155 21481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:44:58.221360 21481 hybrid_clock.cc:648] HybridClock initialized: now 1786448698221313 us; error 82 us; skew 500 ppm
Aug 11 11:44:58 dist-test-slave-vkjp krb5kdc[21464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448698, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:44:58.229166 21481 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:44:58.230455 21481 webserver.cc:460] Webserver started at http://127.20.244.126:38385/ using document root <none> and password file <none>
I20260811 11:44:58.231721 21481 fs_manager.cc:359] Metadata directory not provided
I20260811 11:44:58.231843 21481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:44:58.232285 21481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:44:58.235656 21481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "fe36d8799c42404bb73daaab52da5178"
format_stamp: "Formatted at 2026-08-11 11:44:58 on dist-test-slave-vkjp"
server_key: "e2f43735a08d94cd9371ab04af823b33"
server_key_iv: "b9ff8b4ca9e7b2470e1268e801c10bbe"
server_key_version: "encryptionkey@0"
I20260811 11:44:58.236608 21481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "fe36d8799c42404bb73daaab52da5178"
format_stamp: "Formatted at 2026-08-11 11:44:58 on dist-test-slave-vkjp"
server_key: "e2f43735a08d94cd9371ab04af823b33"
server_key_iv: "b9ff8b4ca9e7b2470e1268e801c10bbe"
server_key_version: "encryptionkey@0"
I20260811 11:44:58.241964 21481 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 11:44:58.245766 21497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:44:58.247633 21481 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 11:44:58.247856 21481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "fe36d8799c42404bb73daaab52da5178"
format_stamp: "Formatted at 2026-08-11 11:44:58 on dist-test-slave-vkjp"
server_key: "e2f43735a08d94cd9371ab04af823b33"
server_key_iv: "b9ff8b4ca9e7b2470e1268e801c10bbe"
server_key_version: "encryptionkey@0"
I20260811 11:44:58.247994 21481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:44:58.277359 21481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:44:58.281195 21481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:44:58.281507 21481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:44:58.291749 21481 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:43451
I20260811 11:44:58.291878 21558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:43451 every 8 connection(s)
I20260811 11:44:58.293146 21481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:44:58.297865 21559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:44:58.302618 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 21481
I20260811 11:44:58.302758 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:44:58.304246 21457 external_mini_cluster.cc:1428] Setting key c8de1d1f8aa7bee7b95b812e85a81119
I20260811 11:44:58.307060 21559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178: Bootstrap starting.
I20260811 11:44:58.312362 21559 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178: Neither blocks nor log segments found. Creating new log.
I20260811 11:44:58.313970 21559 log.cc:824] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178: Log is configured to *not* fsync() on all Append() calls
I20260811 11:44:58.316555 21559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178: No bootstrap required, opened a new log
I20260811 11:44:58.321303 21559 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe36d8799c42404bb73daaab52da5178" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 43451 } }
I20260811 11:44:58.321641 21559 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:44:58.321750 21559 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe36d8799c42404bb73daaab52da5178, State: Initialized, Role: FOLLOWER
I20260811 11:44:58.322570 21559 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe36d8799c42404bb73daaab52da5178" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 43451 } }
I20260811 11:44:58.322837 21559 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:44:58.322970 21559 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:44:58.323132 21559 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:44:58.324127 21559 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe36d8799c42404bb73daaab52da5178" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 43451 } }
I20260811 11:44:58.324744 21559 leader_election.cc:302] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe36d8799c42404bb73daaab52da5178; no voters:
Aug 11 11:44:58 dist-test-slave-vkjp krb5kdc[21464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448698, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:44:58.325172 21559 leader_election.cc:288] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:44:58.325280 21564 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:44:58.325503 21564 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178 [term 1 LEADER]: Becoming Leader. State: Replica: fe36d8799c42404bb73daaab52da5178, State: Running, Role: LEADER
I20260811 11:44:58.325951 21564 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe36d8799c42404bb73daaab52da5178" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 43451 } }
I20260811 11:44:58.327066 21559 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:44:58.327842 21564 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe36d8799c42404bb73daaab52da5178. Latest consensus state: current_term: 1 leader_uuid: "fe36d8799c42404bb73daaab52da5178" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe36d8799c42404bb73daaab52da5178" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 43451 } } }
I20260811 11:44:58.327957 21564 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178 [sys.catalog]: This master's current role is: LEADER
I20260811 11:44:58.331815 21565 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe36d8799c42404bb73daaab52da5178" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe36d8799c42404bb73daaab52da5178" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 43451 } } }
I20260811 11:44:58.331943 21565 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178 [sys.catalog]: This master's current role is: LEADER
I20260811 11:44:58.333230 21561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:44:58.308973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47286 (local address 127.20.244.126:43451)
0811 11:44:58.309569 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0811 11:44:58.309587 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 11:44:58.310825 (+ 1238us) server_negotiation.cc:407] Connection header received
0811 11:44:58.314445 (+ 3620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:44:58.314463 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:44:58.314853 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:44:58.315220 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:44:58.317627 (+ 2407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:44:58.319012 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:44:58.320482 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:44:58.321029 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:44:58.321210 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:44:58.325977 (+ 4767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:44:58.326010 (+ 33us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:44:58.326024 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:44:58.326053 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:44:58.328150 (+ 2097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:44:58.328874 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:44:58.328882 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:44:58.328887 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:44:58.329060 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:44:58.329615 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:44:58.329619 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:44:58.329621 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:44:58.330268 (+ 647us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:44:58.330537 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0811 11:44:58.331471 (+ 934us) server_negotiation.cc:299] Negotiation successful
0811 11:44:58.331911 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":245,"threads_started":1}
W20260811 11:44:58.334345 21583 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:44:58.334471 21583 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:44:58.334568 21569 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:44:58.335633 21569 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:44:58.342631 21569 catalog_manager.cc:1347] Generated new cluster ID: 8e61d5e0025c4cf9b4b4a9c6ff951e1f
I20260811 11:44:58.342706 21569 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:44:58.357967 21569 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:44:58.359447 21569 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:44:58.369282 21569 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe36d8799c42404bb73daaab52da5178: Generated new TSK 0
I20260811 11:44:58.370172 21569 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.244.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
I20260811 11:44:58.408488 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:43451
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:39975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:44:58.532349 21590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:44:58.532619 21590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:44:58.532665 21590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:44:58.537302 21590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:44:58.537371 21590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:44:58.537431 21590 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:44:58.542758 21590 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:39975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:43451
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:44:58.543987 21590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:44:58.545089 21590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:44:58.555470 21597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:44:58.555483 21596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:44:58.555493 21600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:44:58.555837 21590 server_base.cc:1034] running on GCE node
I20260811 11:44:58.556336 21590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:44:58.557037 21590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:44:58.558261 21590 hybrid_clock.cc:648] HybridClock initialized: now 1786448698558242 us; error 26 us; skew 500 ppm
Aug 11 11:44:58 dist-test-slave-vkjp krb5kdc[21464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448698, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:44:58.561323 21590 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:44:58.562276 21590 webserver.cc:460] Webserver started at http://127.20.244.65:43461/ using document root <none> and password file <none>
I20260811 11:44:58.562857 21590 fs_manager.cc:359] Metadata directory not provided
I20260811 11:44:58.562950 21590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:44:58.563261 21590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:44:58.565444 21590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "da11683a0c5046cdb3b7ef5f2bf06f45"
format_stamp: "Formatted at 2026-08-11 11:44:58 on dist-test-slave-vkjp"
server_key: "f95700759fd06ff3694bd67a48b09c70"
server_key_iv: "9f490eba7d2ccfa089d97f05399308b7"
server_key_version: "encryptionkey@0"
I20260811 11:44:58.566103 21590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "da11683a0c5046cdb3b7ef5f2bf06f45"
format_stamp: "Formatted at 2026-08-11 11:44:58 on dist-test-slave-vkjp"
server_key: "f95700759fd06ff3694bd67a48b09c70"
server_key_iv: "9f490eba7d2ccfa089d97f05399308b7"
server_key_version: "encryptionkey@0"
I20260811 11:44:58.570036 21590 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 11:44:58.572499 21608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:44:58.573750 21590 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 11:44:58.573910 21590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "da11683a0c5046cdb3b7ef5f2bf06f45"
format_stamp: "Formatted at 2026-08-11 11:44:58 on dist-test-slave-vkjp"
server_key: "f95700759fd06ff3694bd67a48b09c70"
server_key_iv: "9f490eba7d2ccfa089d97f05399308b7"
server_key_version: "encryptionkey@0"
I20260811 11:44:58.574033 21590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:44:58.587879 21590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:44:58.590670 21590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:44:58.590876 21590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:44:58.591645 21590 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:44:58.592837 21590 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:44:58.592913 21590 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:44:58.592986 21590 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:44:58.593036 21590 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:44:58.605034 21590 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:41209
I20260811 11:44:58.605063 21748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:41209 every 8 connection(s)
I20260811 11:44:58.606074 21590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:44:58.606341 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 21590
I20260811 11:44:58.606426 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:44:58.606642 21457 external_mini_cluster.cc:1428] Setting key d37d2a5fb5fa45d94361fc50629ab65a
Aug 11 11:44:58 dist-test-slave-vkjp krb5kdc[21464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448698, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.244.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.66@KRBTEST.COM" created.
I20260811 11:44:58.623777 21561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:44:58.608794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:54651 (local address 127.20.244.126:43451)
0811 11:44:58.608972 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 11:44:58.608981 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:44:58.609970 (+ 989us) server_negotiation.cc:407] Connection header received
0811 11:44:58.611929 (+ 1959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:44:58.611933 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:44:58.611997 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:44:58.612118 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:44:58.613846 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:44:58.614418 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:44:58.616401 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:44:58.616642 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:44:58.616727 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:44:58.619808 (+ 3081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:44:58.619811 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:44:58.619814 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:44:58.619838 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:44:58.621338 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:44:58.621949 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:44:58.621981 (+ 32us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:44:58.621983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:44:58.622062 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:44:58.622462 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:44:58.622464 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:44:58.622466 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:44:58.622676 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:44:58.622792 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 11:44:58.623492 (+ 700us) server_negotiation.cc:299] Negotiation successful
0811 11:44:58.623647 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 11:44:58.624948 21753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:44:58.609206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:43451 (local address 127.20.244.65:54651)
0811 11:44:58.609768 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0811 11:44:58.609834 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 11:44:58.611692 (+ 1858us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:44:58.612327 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:44:58.612334 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:44:58.612919 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:44:58.613651 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:44:58.613675 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:44:58.614584 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:44:58.614591 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:44:58.616255 (+ 1664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:44:58.616272 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:44:58.616817 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:44:58.616823 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:44:58.617064 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:44:58.617759 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:44:58.617789 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:44:58.619633 (+ 1844us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:44:58.621500 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:44:58.621506 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:44:58.621523 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:44:58.621824 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:44:58.622162 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:44:58.622165 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:44:58.622167 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:44:58.622315 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:44:58.622806 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:44:58.622814 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:44:58.623185 (+ 371us) client_negotiation.cc:769] Sending connection context
0811 11:44:58.623407 (+ 222us) client_negotiation.cc:240] Negotiation successful
0811 11:44:58.623799 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":135,"threads_started":1}
I20260811 11:44:58.626552 21749 heartbeater.cc:347] Connected to a master server at 127.20.244.126:43451
I20260811 11:44:58.626813 21749 heartbeater.cc:464] Registering TS with master...
I20260811 11:44:58.627410 21749 heartbeater.cc:511] Master 127.20.244.126:43451 requested a full tablet report, sending...
I20260811 11:44:58.629765 21517 ts_manager.cc:194] Registered new tserver with Master: da11683a0c5046cdb3b7ef5f2bf06f45 (127.20.244.65:41209)
I20260811 11:44:58.631366 21517 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:54651
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
I20260811 11:44:58.643273 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:43451
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:39975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:44:58.763477 21756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:44:58.763779 21756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:44:58.763857 21756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:44:58.768105 21756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:44:58.768190 21756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:44:58.768278 21756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:44:58.773835 21756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:39975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:43451
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:44:58.775029 21756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:44:58.776234 21756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:44:58.786238 21766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:44:58.786309 21764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:44:58.786392 21756 server_base.cc:1034] running on GCE node
W20260811 11:44:58.786249 21761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:44:58.787127 21756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:44:58.787842 21756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:44:58.789037 21756 hybrid_clock.cc:648] HybridClock initialized: now 1786448698789022 us; error 26 us; skew 500 ppm
Aug 11 11:44:58 dist-test-slave-vkjp krb5kdc[21464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448698, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:44:58.791774 21756 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:44:58.792694 21756 webserver.cc:460] Webserver started at http://127.20.244.66:44215/ using document root <none> and password file <none>
I20260811 11:44:58.793258 21756 fs_manager.cc:359] Metadata directory not provided
I20260811 11:44:58.793345 21756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:44:58.793602 21756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:44:58.795722 21756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "26657ff3a3954441b37aa3681fc45a53"
format_stamp: "Formatted at 2026-08-11 11:44:58 on dist-test-slave-vkjp"
server_key: "1a294ae868c50ace13b9f22a5c84ea7a"
server_key_iv: "ac2d3fceb745c8108cd75c9f0dbd875e"
server_key_version: "encryptionkey@0"
I20260811 11:44:58.796301 21756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "26657ff3a3954441b37aa3681fc45a53"
format_stamp: "Formatted at 2026-08-11 11:44:58 on dist-test-slave-vkjp"
server_key: "1a294ae868c50ace13b9f22a5c84ea7a"
server_key_iv: "ac2d3fceb745c8108cd75c9f0dbd875e"
server_key_version: "encryptionkey@0"
I20260811 11:44:58.800108 21756 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 11:44:58.802629 21774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:44:58.803931 21756 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 11:44:58.804064 21756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "26657ff3a3954441b37aa3681fc45a53"
format_stamp: "Formatted at 2026-08-11 11:44:58 on dist-test-slave-vkjp"
server_key: "1a294ae868c50ace13b9f22a5c84ea7a"
server_key_iv: "ac2d3fceb745c8108cd75c9f0dbd875e"
server_key_version: "encryptionkey@0"
I20260811 11:44:58.804177 21756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:44:58.831203 21756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:44:58.834149 21756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:44:58.834353 21756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:44:58.834965 21756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:44:58.835844 21756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:44:58.835914 21756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:44:58.835983 21756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:44:58.836027 21756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:44:58.845752 21756 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:43317
I20260811 11:44:58.845778 21907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:43317 every 8 connection(s)
I20260811 11:44:58.846848 21756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:44:58.847035 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 21756
I20260811 11:44:58.847182 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:44:58.847503 21457 external_mini_cluster.cc:1428] Setting key 300360c242ef20e43993d80076aec050
Aug 11 11:44:58 dist-test-slave-vkjp krb5kdc[21464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448698, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.244.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.67@KRBTEST.COM" created.
I20260811 11:44:58.862412 21561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:44:58.848932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:50435 (local address 127.20.244.126:43451)
0811 11:44:58.849081 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 11:44:58.849086 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:44:58.850128 (+ 1042us) server_negotiation.cc:407] Connection header received
0811 11:44:58.851553 (+ 1425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:44:58.851556 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:44:58.851613 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:44:58.851692 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:44:58.853212 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:44:58.853738 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:44:58.855511 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:44:58.855742 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:44:58.855857 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:44:58.858309 (+ 2452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:44:58.858313 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:44:58.858318 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:44:58.858348 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:44:58.859765 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:44:58.860297 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:44:58.860301 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:44:58.860302 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:44:58.860418 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:44:58.860902 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:44:58.860906 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:44:58.860907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:44:58.861185 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:44:58.861304 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 11:44:58.862015 (+ 711us) server_negotiation.cc:299] Negotiation successful
0811 11:44:58.862189 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 11:44:58.864326 21910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:44:58.849467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:43451 (local address 127.20.244.66:50435)
0811 11:44:58.849948 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0811 11:44:58.850004 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 11:44:58.851335 (+ 1331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:44:58.851880 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:44:58.851887 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:44:58.852347 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:44:58.853043 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:44:58.853068 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:44:58.853893 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:44:58.853900 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:44:58.855375 (+ 1475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:44:58.855386 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:44:58.855900 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:44:58.855904 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:44:58.856091 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:44:58.856700 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:44:58.856717 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:44:58.858143 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:44:58.859887 (+ 1744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:44:58.859895 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:44:58.859911 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:44:58.860181 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:44:58.860518 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:44:58.860521 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:44:58.860523 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:44:58.860740 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:44:58.861340 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:44:58.861348 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:44:58.861679 (+ 331us) client_negotiation.cc:769] Sending connection context
0811 11:44:58.862615 (+ 936us) client_negotiation.cc:240] Negotiation successful
0811 11:44:58.863049 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":147,"threads_started":1}
I20260811 11:44:58.866070 21908 heartbeater.cc:347] Connected to a master server at 127.20.244.126:43451
I20260811 11:44:58.866321 21908 heartbeater.cc:464] Registering TS with master...
I20260811 11:44:58.866950 21908 heartbeater.cc:511] Master 127.20.244.126:43451 requested a full tablet report, sending...
I20260811 11:44:58.868377 21517 ts_manager.cc:194] Registered new tserver with Master: 26657ff3a3954441b37aa3681fc45a53 (127.20.244.66:43317)
I20260811 11:44:58.869271 21517 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:50435
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
I20260811 11:44:58.882799 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:43451
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:39975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:44:58.998363 21914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:44:58.998672 21914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:44:58.998750 21914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:44:59.002774 21914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:44:59.002867 21914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:44:59.002966 21914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:44:59.008407 21914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:39975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:43451
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:44:59.009575 21914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:44:59.010654 21914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:44:59.020697 21922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:44:59.020721 21924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:44:59.020747 21921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:44:59.020973 21914 server_base.cc:1034] running on GCE node
I20260811 11:44:59.021468 21914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:44:59.022209 21914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:44:59.023386 21914 hybrid_clock.cc:648] HybridClock initialized: now 1786448699023346 us; error 49 us; skew 500 ppm
Aug 11 11:44:59 dist-test-slave-vkjp krb5kdc[21464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448699, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:44:59.026219 21914 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:44:59.027268 21914 webserver.cc:460] Webserver started at http://127.20.244.67:42919/ using document root <none> and password file <none>
I20260811 11:44:59.027845 21914 fs_manager.cc:359] Metadata directory not provided
I20260811 11:44:59.027906 21914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:44:59.028185 21914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:44:59.030385 21914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "dc402f7c3a804f189af560f688869276"
format_stamp: "Formatted at 2026-08-11 11:44:59 on dist-test-slave-vkjp"
server_key: "d92c14e5b52c2fb2b0434ba5b48afdc0"
server_key_iv: "adfe2c1a773a3cadb8c5e2b28015fdfd"
server_key_version: "encryptionkey@0"
I20260811 11:44:59.031044 21914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "dc402f7c3a804f189af560f688869276"
format_stamp: "Formatted at 2026-08-11 11:44:59 on dist-test-slave-vkjp"
server_key: "d92c14e5b52c2fb2b0434ba5b48afdc0"
server_key_iv: "adfe2c1a773a3cadb8c5e2b28015fdfd"
server_key_version: "encryptionkey@0"
I20260811 11:44:59.034837 21914 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 11:44:59.037263 21933 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:44:59.038477 21914 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:44:59.038599 21914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "dc402f7c3a804f189af560f688869276"
format_stamp: "Formatted at 2026-08-11 11:44:59 on dist-test-slave-vkjp"
server_key: "d92c14e5b52c2fb2b0434ba5b48afdc0"
server_key_iv: "adfe2c1a773a3cadb8c5e2b28015fdfd"
server_key_version: "encryptionkey@0"
I20260811 11:44:59.038703 21914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:44:59.051765 21914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:44:59.055061 21914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:44:59.055318 21914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:44:59.055871 21914 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:44:59.056641 21914 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:44:59.056689 21914 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:44:59.056728 21914 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:44:59.056751 21914 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:44:59.067890 21914 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:40721
I20260811 11:44:59.067910 22070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:40721 every 8 connection(s)
I20260811 11:44:59.068881 21914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:44:59.070498 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 21914
I20260811 11:44:59.070622 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:44:59.070943 21457 external_mini_cluster.cc:1428] Setting key f3063ecf9f0605989a69618f9ea0d7ea
Aug 11 11:44:59 dist-test-slave-vkjp krb5kdc[21464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448699, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:44:59.083355 21561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:44:59.070857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:44477 (local address 127.20.244.126:43451)
0811 11:44:59.071025 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 11:44:59.071030 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:44:59.072100 (+ 1070us) server_negotiation.cc:407] Connection header received
0811 11:44:59.073609 (+ 1509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:44:59.073612 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:44:59.073666 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:44:59.073747 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:44:59.074910 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:44:59.075527 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:44:59.076678 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:44:59.076987 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:44:59.077097 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:44:59.079859 (+ 2762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:44:59.079863 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:44:59.079866 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:44:59.079896 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:44:59.081272 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:44:59.081812 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:44:59.081815 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:44:59.081817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:44:59.081904 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:44:59.082253 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:44:59.082257 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:44:59.082259 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:44:59.082463 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:44:59.082575 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 11:44:59.083051 (+ 476us) server_negotiation.cc:299] Negotiation successful
0811 11:44:59.083188 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 11:44:59.084141 22073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:44:59.071366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:43451 (local address 127.20.244.67:44477)
0811 11:44:59.071946 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0811 11:44:59.072002 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 11:44:59.073402 (+ 1400us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:44:59.073926 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:44:59.073933 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:44:59.074280 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:44:59.074770 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:44:59.074785 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:44:59.075654 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:44:59.075657 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:44:59.076548 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:44:59.076558 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:44:59.077136 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:44:59.077141 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:44:59.077320 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:44:59.077899 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:44:59.077915 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:44:59.079690 (+ 1775us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:44:59.081414 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:44:59.081421 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:44:59.081436 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:44:59.081698 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:44:59.082000 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:44:59.082003 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:44:59.082005 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:44:59.082153 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:44:59.082574 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:44:59.082581 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:44:59.082818 (+ 237us) client_negotiation.cc:769] Sending connection context
0811 11:44:59.083007 (+ 189us) client_negotiation.cc:240] Negotiation successful
0811 11:44:59.083349 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":155,"threads_started":1}
I20260811 11:44:59.085433 22071 heartbeater.cc:347] Connected to a master server at 127.20.244.126:43451
I20260811 11:44:59.085680 22071 heartbeater.cc:464] Registering TS with master...
I20260811 11:44:59.086196 22071 heartbeater.cc:511] Master 127.20.244.126:43451 requested a full tablet report, sending...
I20260811 11:44:59.087221 21516 ts_manager.cc:194] Registered new tserver with Master: dc402f7c3a804f189af560f688869276 (127.20.244.67:40721)
I20260811 11:44:59.087760 21516 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:44477
I20260811 11:44:59.097832 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 11:44:59 dist-test-slave-vkjp krb5kdc[21464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448699, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 11:44:59 dist-test-slave-vkjp krb5kdc[21464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448699, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.244.65@KRBTEST.COM
I20260811 11:44:59.125363 22081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:44:59.116302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40410 (local address 127.20.244.65:41209)
0811 11:44:59.116683 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0811 11:44:59.116698 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 11:44:59.116725 (+ 27us) server_negotiation.cc:407] Connection header received
0811 11:44:59.116778 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:44:59.116783 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:44:59.116985 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:44:59.117110 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:44:59.117757 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:44:59.118532 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:44:59.119400 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:44:59.119768 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:44:59.119853 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:44:59.122160 (+ 2307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:44:59.122169 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:44:59.122182 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:44:59.122205 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:44:59.123768 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:44:59.124170 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:44:59.124175 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:44:59.124176 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:44:59.124252 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:44:59.124489 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:44:59.124491 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:44:59.124492 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:44:59.124717 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:44:59.124882 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 11:44:59.125059 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 11:44:59.125179 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":115,"threads_started":1}
W20260811 11:44:59.126397 21640 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40410
Aug 11 11:44:59 dist-test-slave-vkjp krb5kdc[21464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 11:44:59 dist-test-slave-vkjp krb5kdc[21464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.65@KRBTEST.COM
I20260811 11:44:59.154088 22081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:44:59.145636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40424 (local address 127.20.244.65:41209)
0811 11:44:59.145813 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 11:44:59.145818 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:44:59.145962 (+ 144us) server_negotiation.cc:407] Connection header received
0811 11:44:59.146134 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:44:59.146137 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:44:59.146189 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:44:59.146278 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:44:59.146980 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:44:59.147600 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:44:59.148441 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:44:59.148681 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:44:59.148792 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:44:59.151177 (+ 2385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:44:59.151180 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:44:59.151182 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:44:59.151205 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:44:59.152601 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:44:59.153009 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:44:59.153012 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:44:59.153013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:44:59.153087 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:44:59.153359 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:44:59.153361 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:44:59.153363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:44:59.153521 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:44:59.153621 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 11:44:59.153867 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 11:44:59.153967 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 11:44:59.155365 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 21590
I20260811 11:44:59.163511 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 21756
I20260811 11:44:59.171427 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 21914
I20260811 11:44:59.181392 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 21481
2026-08-11T11:44:59Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2454 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:44:59 dist-test-slave-vkjp krb5kdc[22089](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:44:59 dist-test-slave-vkjp krb5kdc[22089](info): set up 2 sockets
Aug 11 11:44:59 dist-test-slave-vkjp krb5kdc[22089](info): commencing operation
krb5kdc: starting...
W20260811 11:45:00.373095 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:45:00 dist-test-slave-vkjp krb5kdc[22089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:45:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:45:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:45:00.503860 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:40701
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:42867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:40701
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:00.617472 22105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:00.617738 22105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:00.617777 22105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:00.621961 22105 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:00.622017 22105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:00.622036 22105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:00.622052 22105 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:00.622105 22105 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:45:00.627375 22105 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:42867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:40701
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:40701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22105
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:00.628445 22105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:00.629485 22105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:45:00.638562 22105 server_base.cc:1034] running on GCE node
W20260811 11:45:00.638499 22112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:00.638511 22111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:00.638494 22115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:00.639376 22105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:00.640591 22105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:00.641790 22105 hybrid_clock.cc:648] HybridClock initialized: now 1786448700641780 us; error 28 us; skew 500 ppm
Aug 11 11:45:00 dist-test-slave-vkjp krb5kdc[22089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448700, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:00.644836 22105 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:45:00.645768 22105 webserver.cc:460] Webserver started at http://127.20.244.126:33505/ using document root <none> and password file <none>
I20260811 11:45:00.646359 22105 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:00.646466 22105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:00.646780 22105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:00.649042 22105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "dd97e3d28a9a4bebabaccf27ad202432"
format_stamp: "Formatted at 2026-08-11 11:45:00 on dist-test-slave-vkjp"
server_key: "751cb9b4528198da0786190e80cff533"
server_key_iv: "48e7ca3ca2fe348af7277a7f42e7d4e1"
server_key_version: "encryptionkey@0"
I20260811 11:45:00.649653 22105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "dd97e3d28a9a4bebabaccf27ad202432"
format_stamp: "Formatted at 2026-08-11 11:45:00 on dist-test-slave-vkjp"
server_key: "751cb9b4528198da0786190e80cff533"
server_key_iv: "48e7ca3ca2fe348af7277a7f42e7d4e1"
server_key_version: "encryptionkey@0"
I20260811 11:45:00.654022 22105 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 11:45:00.656633 22123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:00.657989 22105 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 11:45:00.658143 22105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "dd97e3d28a9a4bebabaccf27ad202432"
format_stamp: "Formatted at 2026-08-11 11:45:00 on dist-test-slave-vkjp"
server_key: "751cb9b4528198da0786190e80cff533"
server_key_iv: "48e7ca3ca2fe348af7277a7f42e7d4e1"
server_key_version: "encryptionkey@0"
I20260811 11:45:00.658269 22105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:00.689409 22105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:00.692975 22105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:00.693202 22105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:00.700711 22105 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:40701
I20260811 11:45:00.700742 22184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:40701 every 8 connection(s)
I20260811 11:45:00.701730 22105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:45:00.704660 22185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:00.710260 22185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432: Bootstrap starting.
I20260811 11:45:00.711258 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 22105
I20260811 11:45:00.711385 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:45:00.711660 21457 external_mini_cluster.cc:1428] Setting key 5f36939e78abb2f02dac3324aae5df19
I20260811 11:45:00.713119 22185 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:00.713861 22185 log.cc:824] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:00.715793 22185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432: No bootstrap required, opened a new log
I20260811 11:45:00.719118 22185 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd97e3d28a9a4bebabaccf27ad202432" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40701 } }
I20260811 11:45:00.719352 22185 raft_consensus.cc:374] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:00.719408 22185 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd97e3d28a9a4bebabaccf27ad202432, State: Initialized, Role: FOLLOWER
I20260811 11:45:00.719854 22185 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd97e3d28a9a4bebabaccf27ad202432" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40701 } }
I20260811 11:45:00.720008 22185 raft_consensus.cc:388] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:45:00.720088 22185 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:45:00.720209 22185 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432 [term 0 FOLLOWER]: Advancing to term 1
Aug 11 11:45:00 dist-test-slave-vkjp krb5kdc[22089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:00.721141 22185 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd97e3d28a9a4bebabaccf27ad202432" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40701 } }
I20260811 11:45:00.721478 22185 leader_election.cc:302] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd97e3d28a9a4bebabaccf27ad202432; no voters:
I20260811 11:45:00.721817 22185 leader_election.cc:288] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:45:00.721966 22190 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:00.722160 22190 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432 [term 1 LEADER]: Becoming Leader. State: Replica: dd97e3d28a9a4bebabaccf27ad202432, State: Running, Role: LEADER
I20260811 11:45:00.722434 22190 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd97e3d28a9a4bebabaccf27ad202432" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40701 } }
I20260811 11:45:00.723059 22185 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:45:00.724335 22193 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd97e3d28a9a4bebabaccf27ad202432" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd97e3d28a9a4bebabaccf27ad202432" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40701 } } }
I20260811 11:45:00.724464 22193 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:00.724803 22194 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd97e3d28a9a4bebabaccf27ad202432. Latest consensus state: current_term: 1 leader_uuid: "dd97e3d28a9a4bebabaccf27ad202432" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd97e3d28a9a4bebabaccf27ad202432" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40701 } } }
I20260811 11:45:00.724916 22194 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:00.726886 22188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:00.712785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39930 (local address 127.20.244.126:40701)
0811 11:45:00.713279 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:00.713295 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:00.713331 (+ 36us) server_negotiation.cc:407] Connection header received
0811 11:45:00.714026 (+ 695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:00.714045 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:00.714466 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:00.714854 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:00.715686 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:00.716693 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:00.717570 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:00.718065 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:00.718244 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:00.721040 (+ 2796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:00.721046 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:00.721066 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:00.721093 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:00.723303 (+ 2210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:00.723830 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:00.723838 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:00.723847 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:00.724013 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:00.724386 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:00.724390 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:00.724391 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:00.724951 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:00.725158 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:00.725946 (+ 788us) server_negotiation.cc:299] Negotiation successful
0811 11:45:00.726179 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":134,"threads_started":1}
W20260811 11:45:00.728416 22209 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:45:00.728498 22209 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:45:00.728566 22203 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:45:00.729274 22203 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:45:00.734179 22203 catalog_manager.cc:1347] Generated new cluster ID: 60b91bc54f624b22aaafb073aa4d528a
I20260811 11:45:00.734244 22203 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:45:00.757182 22203 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:45:00.758124 22203 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:45:00.765039 22203 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dd97e3d28a9a4bebabaccf27ad202432: Generated new TSK 0
I20260811 11:45:00.765689 22203 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.244.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
I20260811 11:45:00.798625 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40701
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:42867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:00.911895 22216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:00.912135 22216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:00.912178 22216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:00.916513 22216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:00.916579 22216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:00.916682 22216 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:45:00.922051 22216 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:42867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40701
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22216
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:00.923204 22216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:00.924341 22216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:00.934018 22223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:00.934046 22216 server_base.cc:1034] running on GCE node
W20260811 11:45:00.934008 22222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:00.934008 22226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:00.934674 22216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:00.935355 22216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:00.936515 22216 hybrid_clock.cc:648] HybridClock initialized: now 1786448700936504 us; error 39 us; skew 500 ppm
Aug 11 11:45:00 dist-test-slave-vkjp krb5kdc[22089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448700, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:00.939249 22216 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:45:00.940059 22216 webserver.cc:460] Webserver started at http://127.20.244.65:42275/ using document root <none> and password file <none>
I20260811 11:45:00.940595 22216 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:00.940656 22216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:00.940917 22216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:00.942909 22216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "a2bee9d952fc41acbea78f8a7a455c8f"
format_stamp: "Formatted at 2026-08-11 11:45:00 on dist-test-slave-vkjp"
server_key: "a6bfabcdf85348aa1469b84270690a33"
server_key_iv: "223d7763ce78bd476000849a5338f930"
server_key_version: "encryptionkey@0"
I20260811 11:45:00.943535 22216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "a2bee9d952fc41acbea78f8a7a455c8f"
format_stamp: "Formatted at 2026-08-11 11:45:00 on dist-test-slave-vkjp"
server_key: "a6bfabcdf85348aa1469b84270690a33"
server_key_iv: "223d7763ce78bd476000849a5338f930"
server_key_version: "encryptionkey@0"
I20260811 11:45:00.947285 22216 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 11:45:00.949780 22235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:00.950994 22216 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:00.951164 22216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "a2bee9d952fc41acbea78f8a7a455c8f"
format_stamp: "Formatted at 2026-08-11 11:45:00 on dist-test-slave-vkjp"
server_key: "a6bfabcdf85348aa1469b84270690a33"
server_key_iv: "223d7763ce78bd476000849a5338f930"
server_key_version: "encryptionkey@0"
I20260811 11:45:00.951283 22216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:00.961426 22216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:00.964227 22216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:00.964413 22216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:00.964951 22216 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:00.965796 22216 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:00.965873 22216 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:00.965945 22216 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:00.965987 22216 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:00.974910 22216 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:44249
I20260811 11:45:00.974941 22371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:44249 every 8 connection(s)
I20260811 11:45:00.975853 22216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
Aug 11 11:45:00 dist-test-slave-vkjp krb5kdc[22089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448700, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:00.985764 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 22216
I20260811 11:45:00.985880 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:45:00.986174 21457 external_mini_cluster.cc:1428] Setting key 8c9581e7d27962803e4392685a432019
I20260811 11:45:00.990034 22188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:00.977694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:40089 (local address 127.20.244.126:40701)
0811 11:45:00.977852 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:00.977857 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:00.978784 (+ 927us) server_negotiation.cc:407] Connection header received
0811 11:45:00.979960 (+ 1176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:00.979963 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:00.980012 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:00.980096 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:00.981214 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:00.981764 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:00.982845 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:00.983145 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:00.983230 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:00.985694 (+ 2464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:00.985698 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:00.985702 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:00.985733 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:00.987316 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:00.988331 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:00.988335 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:00.988337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:00.988521 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:00.988898 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:00.988902 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:00.988904 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:00.989107 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:00.989216 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:00.989705 (+ 489us) server_negotiation.cc:299] Negotiation successful
0811 11:45:00.989827 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 11:45:00.990804 22374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:00.978040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40701 (local address 127.20.244.65:40089)
0811 11:45:00.978562 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:00.978642 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:00.979736 (+ 1094us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:00.980254 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:00.980260 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:00.980597 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:00.981075 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:00.981089 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:00.981872 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:00.981875 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:00.982733 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:00.982743 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:00.983288 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:00.983290 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:00.983431 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:00.984037 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:00.984053 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:00.985528 (+ 1475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:00.987826 (+ 2298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:00.987834 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:00.987848 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:00.988191 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:00.988640 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:00.988643 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:00.988645 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:00.988789 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:00.989215 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:00.989221 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:00.989474 (+ 253us) client_negotiation.cc:769] Sending connection context
0811 11:45:00.989662 (+ 188us) client_negotiation.cc:240] Negotiation successful
0811 11:45:00.989987 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":137,"threads_started":1}
I20260811 11:45:00.992087 22372 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40701
I20260811 11:45:00.992329 22372 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:00.992825 22372 heartbeater.cc:511] Master 127.20.244.126:40701 requested a full tablet report, sending...
I20260811 11:45:00.994351 22142 ts_manager.cc:194] Registered new tserver with Master: a2bee9d952fc41acbea78f8a7a455c8f (127.20.244.65:44249)
I20260811 11:45:00.995514 22142 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:40089
WARNING: no policy specified for kudu/127.20.244.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
I20260811 11:45:01.014101 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40701
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:42867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:01.128561 22377 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:01.128800 22377 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:01.128844 22377 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:01.132920 22377 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:01.132974 22377 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:01.133031 22377 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:45:01.138010 22377 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:42867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40701
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22377
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:01.138952 22377 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:01.140065 22377 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:01.149808 22384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:01.149776 22386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:01.149782 22382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:01.149931 22377 server_base.cc:1034] running on GCE node
I20260811 11:45:01.150578 22377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:01.151288 22377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:01.152490 22377 hybrid_clock.cc:648] HybridClock initialized: now 1786448701152462 us; error 36 us; skew 500 ppm
Aug 11 11:45:01 dist-test-slave-vkjp krb5kdc[22089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448701, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:01.155398 22377 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:45:01.156246 22377 webserver.cc:460] Webserver started at http://127.20.244.66:43727/ using document root <none> and password file <none>
I20260811 11:45:01.156800 22377 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:01.156891 22377 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:01.157119 22377 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:01.159139 22377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "5310166ff5314ef9857b14e6124e94c4"
format_stamp: "Formatted at 2026-08-11 11:45:01 on dist-test-slave-vkjp"
server_key: "b52c68a9edb89a49539cb9219159041d"
server_key_iv: "8e8a1702a4ad2cf96b6497c7e0d660f7"
server_key_version: "encryptionkey@0"
I20260811 11:45:01.159722 22377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "5310166ff5314ef9857b14e6124e94c4"
format_stamp: "Formatted at 2026-08-11 11:45:01 on dist-test-slave-vkjp"
server_key: "b52c68a9edb89a49539cb9219159041d"
server_key_iv: "8e8a1702a4ad2cf96b6497c7e0d660f7"
server_key_version: "encryptionkey@0"
I20260811 11:45:01.163447 22377 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 11:45:01.165755 22395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:01.166957 22377 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:01.167150 22377 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "5310166ff5314ef9857b14e6124e94c4"
format_stamp: "Formatted at 2026-08-11 11:45:01 on dist-test-slave-vkjp"
server_key: "b52c68a9edb89a49539cb9219159041d"
server_key_iv: "8e8a1702a4ad2cf96b6497c7e0d660f7"
server_key_version: "encryptionkey@0"
I20260811 11:45:01.167325 22377 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:01.185958 22377 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:01.189046 22377 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:01.189281 22377 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:01.189911 22377 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:01.190804 22377 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:01.190882 22377 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:01.190963 22377 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:01.191020 22377 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:01.200862 22377 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:41397
I20260811 11:45:01.200914 22532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:41397 every 8 connection(s)
I20260811 11:45:01.201831 22377 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:45:01.211154 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 22377
Aug 11 11:45:01 dist-test-slave-vkjp krb5kdc[22089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448701, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:01.211283 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:45:01.211592 21457 external_mini_cluster.cc:1428] Setting key 9f064283c792b06379b6930bbb732e37
I20260811 11:45:01.216341 22188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:01.203635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:44283 (local address 127.20.244.126:40701)
0811 11:45:01.203818 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:01.203822 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:01.204916 (+ 1094us) server_negotiation.cc:407] Connection header received
0811 11:45:01.205842 (+ 926us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:01.205845 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:01.205905 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:01.206008 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:01.207172 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.207696 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.208876 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.209096 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.209207 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:01.212008 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:01.212014 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:01.212017 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:01.212051 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:01.213727 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:01.214426 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:01.214429 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:01.214430 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:01.214519 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:01.214973 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:01.214976 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:01.214977 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:01.215222 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:01.215316 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:01.215962 (+ 646us) server_negotiation.cc:299] Negotiation successful
0811 11:45:01.216127 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 11:45:01.217024 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:01.204008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40701 (local address 127.20.244.66:44283)
0811 11:45:01.204760 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:01.204801 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:01.205628 (+ 827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:01.206178 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:01.206184 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:01.206533 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:01.206993 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:01.207006 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.207824 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.207828 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:01.208733 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:01.208743 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.209248 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.209252 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:01.209417 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:01.210046 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:01.210062 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:01.211808 (+ 1746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:01.213861 (+ 2053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:01.213870 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:01.213888 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:01.214313 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:01.214621 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:01.214626 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:01.214631 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:01.214865 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:01.215334 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:01.215344 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:01.215699 (+ 355us) client_negotiation.cc:769] Sending connection context
0811 11:45:01.215865 (+ 166us) client_negotiation.cc:240] Negotiation successful
0811 11:45:01.216129 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":125,"threads_started":1}
I20260811 11:45:01.218210 22533 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40701
I20260811 11:45:01.218456 22533 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:01.219004 22533 heartbeater.cc:511] Master 127.20.244.126:40701 requested a full tablet report, sending...
I20260811 11:45:01.220170 22142 ts_manager.cc:194] Registered new tserver with Master: 5310166ff5314ef9857b14e6124e94c4 (127.20.244.66:41397)
I20260811 11:45:01.220752 22142 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:44283
WARNING: no policy specified for kudu/127.20.244.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
I20260811 11:45:01.241793 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40701
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:42867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:01.352730 22538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:01.352975 22538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:01.353017 22538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:01.357110 22538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:01.357163 22538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:01.357219 22538 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:45:01.362366 22538 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:42867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40701
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:01.363438 22538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:01.364396 22538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:01.374395 22548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:01.374395 22544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:01.374446 22545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:01.374498 22538 server_base.cc:1034] running on GCE node
I20260811 11:45:01.375147 22538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:01.375788 22538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:01.376979 22538 hybrid_clock.cc:648] HybridClock initialized: now 1786448701376966 us; error 24 us; skew 500 ppm
Aug 11 11:45:01 dist-test-slave-vkjp krb5kdc[22089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448701, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:01.379801 22538 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:45:01.380615 22538 webserver.cc:460] Webserver started at http://127.20.244.67:40695/ using document root <none> and password file <none>
I20260811 11:45:01.381141 22538 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:01.381201 22538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:01.381371 22538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:01.383654 22538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "f4a28b6d02774d0cb4547e97df618a17"
format_stamp: "Formatted at 2026-08-11 11:45:01 on dist-test-slave-vkjp"
server_key: "8920e2c4f4491ca625a4afdb27098873"
server_key_iv: "93b8edb0676c473717eb3fec5321d9c5"
server_key_version: "encryptionkey@0"
I20260811 11:45:01.384183 22538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "f4a28b6d02774d0cb4547e97df618a17"
format_stamp: "Formatted at 2026-08-11 11:45:01 on dist-test-slave-vkjp"
server_key: "8920e2c4f4491ca625a4afdb27098873"
server_key_iv: "93b8edb0676c473717eb3fec5321d9c5"
server_key_version: "encryptionkey@0"
I20260811 11:45:01.387913 22538 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 11:45:01.390195 22556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:01.391479 22538 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 11:45:01.391618 22538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "f4a28b6d02774d0cb4547e97df618a17"
format_stamp: "Formatted at 2026-08-11 11:45:01 on dist-test-slave-vkjp"
server_key: "8920e2c4f4491ca625a4afdb27098873"
server_key_iv: "93b8edb0676c473717eb3fec5321d9c5"
server_key_version: "encryptionkey@0"
I20260811 11:45:01.391727 22538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:01.431553 22538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:01.434523 22538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:01.434738 22538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:01.435555 22538 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:01.436434 22538 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:01.436504 22538 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:01.436570 22538 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:01.436600 22538 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:01.445658 22538 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:43507
I20260811 11:45:01.445685 22695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:43507 every 8 connection(s)
I20260811 11:45:01.446552 22538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:45:01.448377 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 22538
I20260811 11:45:01.448521 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:45:01.448812 21457 external_mini_cluster.cc:1428] Setting key a30ac8eede63368c0f8e85f10d23a259
Aug 11 11:45:01 dist-test-slave-vkjp krb5kdc[22089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448701, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:01.460376 22188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:01.448402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:33045 (local address 127.20.244.126:40701)
0811 11:45:01.448634 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:01.448638 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:01.449893 (+ 1255us) server_negotiation.cc:407] Connection header received
0811 11:45:01.450926 (+ 1033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:01.450929 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:01.450982 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:01.451047 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:01.452225 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.452915 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.454121 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.454348 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.454436 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:01.457072 (+ 2636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:01.457075 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:01.457077 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:01.457102 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:01.458585 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:01.459023 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:01.459025 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:01.459027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:01.459152 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:01.459479 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:01.459481 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:01.459482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:01.459651 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:01.459727 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:01.460163 (+ 436us) server_negotiation.cc:299] Negotiation successful
0811 11:45:01.460257 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260811 11:45:01.461220 22698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:01.448882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40701 (local address 127.20.244.67:33045)
0811 11:45:01.449748 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:01.449792 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:01.450701 (+ 909us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:01.451239 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:01.451246 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:01.451597 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:01.452076 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:01.452090 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.453039 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.453042 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:01.454009 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:01.454018 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.454478 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.454481 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:01.454679 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:01.455396 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:01.455413 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:01.456918 (+ 1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:01.458683 (+ 1765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:01.458688 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:01.458698 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:01.458937 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:01.459232 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:01.459234 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:01.459236 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:01.459394 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:01.459737 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:01.459742 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:01.459961 (+ 219us) client_negotiation.cc:769] Sending connection context
0811 11:45:01.460113 (+ 152us) client_negotiation.cc:240] Negotiation successful
0811 11:45:01.460369 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"thread_start_us":164,"threads_started":1}
I20260811 11:45:01.462436 22696 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40701
I20260811 11:45:01.462715 22696 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:01.463300 22696 heartbeater.cc:511] Master 127.20.244.126:40701 requested a full tablet report, sending...
I20260811 11:45:01.464259 22142 ts_manager.cc:194] Registered new tserver with Master: f4a28b6d02774d0cb4547e97df618a17 (127.20.244.67:43507)
I20260811 11:45:01.464769 22142 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:33045
I20260811 11:45:01.474632 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:45:01.486476 22188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:01.479182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39938 (local address 127.20.244.126:40701)
0811 11:45:01.479363 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:01.479368 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:01.479492 (+ 124us) server_negotiation.cc:407] Connection header received
0811 11:45:01.479645 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:01.479648 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:01.479712 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:01.479798 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:01.480507 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.481028 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.481867 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.482083 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.482192 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:01.483539 (+ 1347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:01.483543 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:01.483545 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:01.483570 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:01.484794 (+ 1224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:01.485226 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:01.485230 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:01.485231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:01.485320 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:01.485595 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:01.485599 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:01.485600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:01.485812 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:01.485950 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:01.486191 (+ 241us) server_negotiation.cc:299] Negotiation successful
0811 11:45:01.486316 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 11:45:01.492102 22142 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39938:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:45:01.495520 22142 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:45:01.511572 22708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:01.505673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60174 (local address 127.20.244.66:41397)
0811 11:45:01.506328 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:01.506342 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:01.506369 (+ 27us) server_negotiation.cc:407] Connection header received
0811 11:45:01.506447 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:01.506454 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:01.506753 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:01.506933 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:01.507282 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.508352 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.509971 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.510840 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.510963 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:01.511212 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:01.511309 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 11:45:01.511403 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":118,"threads_started":1}
I20260811 11:45:01.511559 22707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:01.505544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:41397 (local address 127.0.0.1:60174)
0811 11:45:01.505894 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:01.505958 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:01.506081 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:01.506914 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:01.506920 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:01.506944 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:01.507133 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:01.507144 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.508524 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.508527 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:01.509826 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:01.509837 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.510965 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.510968 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:01.511125 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:01.511170 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 11:45:01.511281 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 11:45:01.511403 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":1,"thread_start_us":71,"threads_started":1}
I20260811 11:45:01.512048 22709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:01.506229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:44249 (local address 127.0.0.1:45106)
0811 11:45:01.506495 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:01.506507 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:01.506577 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:01.507798 (+ 1221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:01.507801 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:01.507821 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:01.507919 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:01.507925 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.509492 (+ 1567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.509496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:01.510441 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:01.510449 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.511620 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.511626 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:01.511722 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:01.511748 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 11:45:01.511825 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 11:45:01.511903 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":55,"thread_start_us":110,"threads_started":1}
I20260811 11:45:01.512533 22711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:01.506907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45106 (local address 127.20.244.65:44249)
0811 11:45:01.507321 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:01.507329 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:01.507353 (+ 24us) server_negotiation.cc:407] Connection header received
0811 11:45:01.507438 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:01.507442 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:01.507616 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:01.507768 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:01.508041 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.509362 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.510564 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.511301 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.511415 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:01.511553 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:01.512278 (+ 725us) server_negotiation.cc:299] Negotiation successful
0811 11:45:01.512377 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":106,"threads_started":1}
I20260811 11:45:01.512760 22710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:01.506662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:43507 (local address 127.0.0.1:60998)
0811 11:45:01.507223 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:01.507239 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:01.507316 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:01.508040 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:01.508042 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:01.508057 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:01.508120 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:01.508124 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.509520 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.509523 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:01.510696 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:01.510708 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.512374 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.512377 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:01.512460 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:01.512482 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 11:45:01.512564 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 11:45:01.512641 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"mutex_wait_us":38,"thread_start_us":84,"threads_started":1}
I20260811 11:45:01.512850 22712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:01.506841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60998 (local address 127.20.244.67:43507)
0811 11:45:01.507321 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:01.507332 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:01.507353 (+ 21us) server_negotiation.cc:407] Connection header received
0811 11:45:01.507427 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:01.507433 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:01.507616 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:01.507768 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:01.508226 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.509364 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.510831 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.511664 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.512155 (+ 491us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:01.512311 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:01.512600 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 11:45:01.512700 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":188,"threads_started":1}
I20260811 11:45:01.515228 22293 tablet_service.cc:1467] Processing CreateTablet for tablet e5f412b2dacc455486d49952022798af (DEFAULT_TABLE table=test-table [id=05b96eb38ef649febafe82c92ca6b607]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:01.515444 22616 tablet_service.cc:1467] Processing CreateTablet for tablet e5f412b2dacc455486d49952022798af (DEFAULT_TABLE table=test-table [id=05b96eb38ef649febafe82c92ca6b607]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:01.516300 22293 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5f412b2dacc455486d49952022798af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:01.516438 22616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5f412b2dacc455486d49952022798af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:01.517050 22450 tablet_service.cc:1467] Processing CreateTablet for tablet e5f412b2dacc455486d49952022798af (DEFAULT_TABLE table=test-table [id=05b96eb38ef649febafe82c92ca6b607]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:01.518004 22450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5f412b2dacc455486d49952022798af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:01.522838 22713 tablet_bootstrap.cc:492] T e5f412b2dacc455486d49952022798af P f4a28b6d02774d0cb4547e97df618a17: Bootstrap starting.
I20260811 11:45:01.524871 22716 tablet_bootstrap.cc:492] T e5f412b2dacc455486d49952022798af P 5310166ff5314ef9857b14e6124e94c4: Bootstrap starting.
I20260811 11:45:01.525475 22714 tablet_bootstrap.cc:492] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f: Bootstrap starting.
I20260811 11:45:01.526010 22713 tablet_bootstrap.cc:654] T e5f412b2dacc455486d49952022798af P f4a28b6d02774d0cb4547e97df618a17: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:01.527175 22713 log.cc:824] T e5f412b2dacc455486d49952022798af P f4a28b6d02774d0cb4547e97df618a17: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:01.527490 22716 tablet_bootstrap.cc:654] T e5f412b2dacc455486d49952022798af P 5310166ff5314ef9857b14e6124e94c4: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:01.527633 22714 tablet_bootstrap.cc:654] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:01.528369 22716 log.cc:824] T e5f412b2dacc455486d49952022798af P 5310166ff5314ef9857b14e6124e94c4: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:01.528369 22714 log.cc:824] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:01.529228 22713 tablet_bootstrap.cc:492] T e5f412b2dacc455486d49952022798af P f4a28b6d02774d0cb4547e97df618a17: No bootstrap required, opened a new log
I20260811 11:45:01.529443 22713 ts_tablet_manager.cc:1397] T e5f412b2dacc455486d49952022798af P f4a28b6d02774d0cb4547e97df618a17: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 11:45:01.530318 22714 tablet_bootstrap.cc:492] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f: No bootstrap required, opened a new log
I20260811 11:45:01.530519 22714 ts_tablet_manager.cc:1397] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 11:45:01.530885 22716 tablet_bootstrap.cc:492] T e5f412b2dacc455486d49952022798af P 5310166ff5314ef9857b14e6124e94c4: No bootstrap required, opened a new log
I20260811 11:45:01.531107 22716 ts_tablet_manager.cc:1397] T e5f412b2dacc455486d49952022798af P 5310166ff5314ef9857b14e6124e94c4: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260811 11:45:01.532501 22713 raft_consensus.cc:348] T e5f412b2dacc455486d49952022798af P f4a28b6d02774d0cb4547e97df618a17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5310166ff5314ef9857b14e6124e94c4" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 41397 } } peers { permanent_uuid: "a2bee9d952fc41acbea78f8a7a455c8f" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 44249 } } peers { permanent_uuid: "f4a28b6d02774d0cb4547e97df618a17" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43507 } }
I20260811 11:45:01.532747 22713 raft_consensus.cc:374] T e5f412b2dacc455486d49952022798af P f4a28b6d02774d0cb4547e97df618a17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:01.532809 22713 raft_consensus.cc:729] T e5f412b2dacc455486d49952022798af P f4a28b6d02774d0cb4547e97df618a17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a28b6d02774d0cb4547e97df618a17, State: Initialized, Role: FOLLOWER
I20260811 11:45:01.533319 22713 consensus_queue.cc:260] T e5f412b2dacc455486d49952022798af P f4a28b6d02774d0cb4547e97df618a17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5310166ff5314ef9857b14e6124e94c4" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 41397 } } peers { permanent_uuid: "a2bee9d952fc41acbea78f8a7a455c8f" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 44249 } } peers { permanent_uuid: "f4a28b6d02774d0cb4547e97df618a17" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43507 } }
I20260811 11:45:01.534255 22713 ts_tablet_manager.cc:1428] T e5f412b2dacc455486d49952022798af P f4a28b6d02774d0cb4547e97df618a17: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 11:45:01.534670 22696 heartbeater.cc:503] Master 127.20.244.126:40701 was elected leader, sending a full tablet report...
I20260811 11:45:01.535140 22716 raft_consensus.cc:348] T e5f412b2dacc455486d49952022798af P 5310166ff5314ef9857b14e6124e94c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5310166ff5314ef9857b14e6124e94c4" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 41397 } } peers { permanent_uuid: "a2bee9d952fc41acbea78f8a7a455c8f" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 44249 } } peers { permanent_uuid: "f4a28b6d02774d0cb4547e97df618a17" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43507 } }
I20260811 11:45:01.535418 22716 raft_consensus.cc:374] T e5f412b2dacc455486d49952022798af P 5310166ff5314ef9857b14e6124e94c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:01.535473 22716 raft_consensus.cc:729] T e5f412b2dacc455486d49952022798af P 5310166ff5314ef9857b14e6124e94c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5310166ff5314ef9857b14e6124e94c4, State: Initialized, Role: FOLLOWER
I20260811 11:45:01.535333 22714 raft_consensus.cc:348] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5310166ff5314ef9857b14e6124e94c4" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 41397 } } peers { permanent_uuid: "a2bee9d952fc41acbea78f8a7a455c8f" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 44249 } } peers { permanent_uuid: "f4a28b6d02774d0cb4547e97df618a17" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43507 } }
I20260811 11:45:01.535570 22714 raft_consensus.cc:374] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:01.535624 22714 raft_consensus.cc:729] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2bee9d952fc41acbea78f8a7a455c8f, State: Initialized, Role: FOLLOWER
I20260811 11:45:01.535892 22716 consensus_queue.cc:260] T e5f412b2dacc455486d49952022798af P 5310166ff5314ef9857b14e6124e94c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5310166ff5314ef9857b14e6124e94c4" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 41397 } } peers { permanent_uuid: "a2bee9d952fc41acbea78f8a7a455c8f" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 44249 } } peers { permanent_uuid: "f4a28b6d02774d0cb4547e97df618a17" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43507 } }
I20260811 11:45:01.535965 22714 consensus_queue.cc:260] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5310166ff5314ef9857b14e6124e94c4" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 41397 } } peers { permanent_uuid: "a2bee9d952fc41acbea78f8a7a455c8f" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 44249 } } peers { permanent_uuid: "f4a28b6d02774d0cb4547e97df618a17" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43507 } }
I20260811 11:45:01.536672 22533 heartbeater.cc:503] Master 127.20.244.126:40701 was elected leader, sending a full tablet report...
I20260811 11:45:01.536845 22716 ts_tablet_manager.cc:1428] T e5f412b2dacc455486d49952022798af P 5310166ff5314ef9857b14e6124e94c4: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260811 11:45:01.537230 22714 ts_tablet_manager.cc:1428] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 11:45:01.537562 22372 heartbeater.cc:503] Master 127.20.244.126:40701 was elected leader, sending a full tablet report...
I20260811 11:45:01.682778 22722 raft_consensus.cc:482] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:45:01.683029 22722 raft_consensus.cc:504] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5310166ff5314ef9857b14e6124e94c4" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 41397 } } peers { permanent_uuid: "a2bee9d952fc41acbea78f8a7a455c8f" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 44249 } } peers { permanent_uuid: "f4a28b6d02774d0cb4547e97df618a17" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43507 } }
I20260811 11:45:01.684262 22722 leader_election.cc:288] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5310166ff5314ef9857b14e6124e94c4 (127.20.244.66:41397), f4a28b6d02774d0cb4547e97df618a17 (127.20.244.67:43507)
I20260811 11:45:01.688304 22708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:01.684730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:40283 (local address 127.20.244.66:41397)
0811 11:45:01.684899 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:01.684905 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:01.685139 (+ 234us) server_negotiation.cc:407] Connection header received
0811 11:45:01.685296 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:01.685300 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:01.685369 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:01.685467 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:01.685752 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.686265 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.687389 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.687766 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.687891 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:01.687944 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:01.688121 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 11:45:01.688187 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 11:45:01.688330 22725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:01.684632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:41397 (local address 127.20.244.65:40283)
0811 11:45:01.684991 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:01.685004 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:01.685164 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:01.685479 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:01.685482 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:01.685501 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:01.685634 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:01.685640 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.686383 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.686388 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:01.687259 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:01.687269 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.687891 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.687895 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:01.687998 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:01.688016 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 11:45:01.688103 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 11:45:01.688168 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":150,"threads_started":1}
I20260811 11:45:01.688689 22712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:01.685260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:33019 (local address 127.20.244.67:43507)
0811 11:45:01.685396 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:01.685400 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:01.685552 (+ 152us) server_negotiation.cc:407] Connection header received
0811 11:45:01.685682 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:01.685685 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:01.685724 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:01.685808 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:01.686086 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.686573 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.687689 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.688086 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.688215 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:01.688260 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:01.688504 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 11:45:01.688580 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 11:45:01.689019 22726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:01.685076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:43507 (local address 127.20.244.65:33019)
0811 11:45:01.685447 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:01.685460 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:01.685583 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:01.685818 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:01.685821 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:01.685837 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:01.685969 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:01.685975 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.686686 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.686691 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:01.687560 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:01.687570 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.688212 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.688216 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:01.688317 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:01.688339 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 11:45:01.688838 (+ 499us) client_negotiation.cc:240] Negotiation successful
0811 11:45:01.688912 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":114,"threads_started":1}
I20260811 11:45:01.689173 22478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5f412b2dacc455486d49952022798af" candidate_uuid: "a2bee9d952fc41acbea78f8a7a455c8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5310166ff5314ef9857b14e6124e94c4" is_pre_election: true
I20260811 11:45:01.689641 22478 raft_consensus.cc:2454] T e5f412b2dacc455486d49952022798af P 5310166ff5314ef9857b14e6124e94c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2bee9d952fc41acbea78f8a7a455c8f in term 0.
I20260811 11:45:01.689657 22638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5f412b2dacc455486d49952022798af" candidate_uuid: "a2bee9d952fc41acbea78f8a7a455c8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a28b6d02774d0cb4547e97df618a17" is_pre_election: true
I20260811 11:45:01.689936 22638 raft_consensus.cc:2454] T e5f412b2dacc455486d49952022798af P f4a28b6d02774d0cb4547e97df618a17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2bee9d952fc41acbea78f8a7a455c8f in term 0.
I20260811 11:45:01.690325 22236 leader_election.cc:302] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5310166ff5314ef9857b14e6124e94c4, a2bee9d952fc41acbea78f8a7a455c8f; no voters:
I20260811 11:45:01.690634 22722 raft_consensus.cc:2781] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:45:01.690750 22722 raft_consensus.cc:482] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:45:01.690809 22722 raft_consensus.cc:3037] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:01.691975 22722 raft_consensus.cc:504] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5310166ff5314ef9857b14e6124e94c4" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 41397 } } peers { permanent_uuid: "a2bee9d952fc41acbea78f8a7a455c8f" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 44249 } } peers { permanent_uuid: "f4a28b6d02774d0cb4547e97df618a17" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43507 } }
I20260811 11:45:01.692302 22722 leader_election.cc:288] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f [CANDIDATE]: Term 1 election: Requested vote from peers 5310166ff5314ef9857b14e6124e94c4 (127.20.244.66:41397), f4a28b6d02774d0cb4547e97df618a17 (127.20.244.67:43507)
I20260811 11:45:01.692809 22478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5f412b2dacc455486d49952022798af" candidate_uuid: "a2bee9d952fc41acbea78f8a7a455c8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5310166ff5314ef9857b14e6124e94c4"
I20260811 11:45:01.692901 22638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5f412b2dacc455486d49952022798af" candidate_uuid: "a2bee9d952fc41acbea78f8a7a455c8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a28b6d02774d0cb4547e97df618a17"
I20260811 11:45:01.692915 22478 raft_consensus.cc:3037] T e5f412b2dacc455486d49952022798af P 5310166ff5314ef9857b14e6124e94c4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:01.693142 22638 raft_consensus.cc:3037] T e5f412b2dacc455486d49952022798af P f4a28b6d02774d0cb4547e97df618a17 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:01.694128 22478 raft_consensus.cc:2454] T e5f412b2dacc455486d49952022798af P 5310166ff5314ef9857b14e6124e94c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2bee9d952fc41acbea78f8a7a455c8f in term 1.
I20260811 11:45:01.694327 22638 raft_consensus.cc:2454] T e5f412b2dacc455486d49952022798af P f4a28b6d02774d0cb4547e97df618a17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2bee9d952fc41acbea78f8a7a455c8f in term 1.
I20260811 11:45:01.694492 22236 leader_election.cc:302] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5310166ff5314ef9857b14e6124e94c4, a2bee9d952fc41acbea78f8a7a455c8f; no voters:
I20260811 11:45:01.694676 22722 raft_consensus.cc:2781] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:01.694916 22722 raft_consensus.cc:686] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f [term 1 LEADER]: Becoming Leader. State: Replica: a2bee9d952fc41acbea78f8a7a455c8f, State: Running, Role: LEADER
I20260811 11:45:01.695325 22722 consensus_queue.cc:237] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5310166ff5314ef9857b14e6124e94c4" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 41397 } } peers { permanent_uuid: "a2bee9d952fc41acbea78f8a7a455c8f" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 44249 } } peers { permanent_uuid: "f4a28b6d02774d0cb4547e97df618a17" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43507 } }
W20260811 11:45:01.697568 22697 tablet.cc:2369] T e5f412b2dacc455486d49952022798af P f4a28b6d02774d0cb4547e97df618a17: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:45:01.698884 22142 catalog_manager.cc:5495] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f reported cstate change: term changed from 0 to 1, leader changed from <none> to a2bee9d952fc41acbea78f8a7a455c8f (127.20.244.65). New cstate: current_term: 1 leader_uuid: "a2bee9d952fc41acbea78f8a7a455c8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5310166ff5314ef9857b14e6124e94c4" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 41397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2bee9d952fc41acbea78f8a7a455c8f" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 44249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4a28b6d02774d0cb4547e97df618a17" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43507 } health_report { overall_health: UNKNOWN } } }
W20260811 11:45:01.703069 22534 tablet.cc:2369] T e5f412b2dacc455486d49952022798af P 5310166ff5314ef9857b14e6124e94c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:45:01.727296 22373 tablet.cc:2369] T e5f412b2dacc455486d49952022798af P a2bee9d952fc41acbea78f8a7a455c8f: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 11:45:01 dist-test-slave-vkjp krb5kdc[22089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.65@KRBTEST.COM
I20260811 11:45:01.746780 22711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:01.737843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45122 (local address 127.20.244.65:44249)
0811 11:45:01.737995 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:01.738000 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:01.738162 (+ 162us) server_negotiation.cc:407] Connection header received
0811 11:45:01.738319 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:01.738322 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:01.738384 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:01.738477 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:01.739200 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.739707 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.740561 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.740776 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.740891 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:01.743339 (+ 2448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:01.743355 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:01.743379 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:01.743404 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:01.744933 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:01.745385 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:01.745391 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:01.745392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:01.745473 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:01.745777 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:01.745781 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:01.745782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:01.746046 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:01.746296 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:01.746483 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 11:45:01.746604 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
Aug 11 11:45:01 dist-test-slave-vkjp krb5kdc[22089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448701, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 11:45:01 dist-test-slave-vkjp krb5kdc[22089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448701, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.244.65@KRBTEST.COM
I20260811 11:45:01.775527 22711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:01.766712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45128 (local address 127.20.244.65:44249)
0811 11:45:01.766875 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:01.766880 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:01.767022 (+ 142us) server_negotiation.cc:407] Connection header received
0811 11:45:01.767215 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:01.767218 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:01.767260 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:01.767344 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:01.768011 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.768503 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.769338 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.769580 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.769689 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:01.772363 (+ 2674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:01.772366 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:01.772368 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:01.772392 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:01.773979 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:01.774348 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:01.774350 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:01.774351 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:01.774423 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:01.774648 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:01.774650 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:01.774651 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:01.774833 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:01.774979 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:01.775245 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 11:45:01.775340 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
Aug 11 11:45:01 dist-test-slave-vkjp krb5kdc[22089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 11:45:01 dist-test-slave-vkjp krb5kdc[22089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.65@KRBTEST.COM
I20260811 11:45:01.802011 22711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:01.793929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45140 (local address 127.20.244.65:44249)
0811 11:45:01.794094 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:01.794098 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:01.794156 (+ 58us) server_negotiation.cc:407] Connection header received
0811 11:45:01.794265 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:01.794267 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:01.794310 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:01.794379 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:01.795141 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.795639 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.796597 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:01.796802 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:01.796877 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:01.799181 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:01.799185 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:01.799187 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:01.799209 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:01.800399 (+ 1190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:01.800777 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:01.800780 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:01.800781 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:01.800865 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:01.801111 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:01.801113 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:01.801114 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:01.801264 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:01.801378 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:01.801631 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 11:45:01.801879 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260811 11:45:01.803857 22267 tablet_service.cc:2908] Rejecting scan request for tablet e5f412b2dacc455486d49952022798af: Uninitialized: clean time has not yet been initialized
I20260811 11:45:01.806480 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 22216
I20260811 11:45:01.815961 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 22377
I20260811 11:45:01.826408 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 22538
I20260811 11:45:01.833690 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 22105
2026-08-11T11:45:01Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2650 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:45:01 dist-test-slave-vkjp krb5kdc[22742](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:45:01 dist-test-slave-vkjp krb5kdc[22742](info): set up 2 sockets
Aug 11 11:45:01 dist-test-slave-vkjp krb5kdc[22742](info): commencing operation
krb5kdc: starting...
W20260811 11:45:02.964566 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:45:03 dist-test-slave-vkjp krb5kdc[22742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448703, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:45:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:45:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:45:03.090394 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:44193
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:41895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:44193
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:03.202889 22761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:03.203200 22761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:03.203279 22761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:03.207244 22761 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:03.207304 22761 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 11:45:03.207321 22761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:03.207383 22761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:03.207412 22761 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:03.207443 22761 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:45:03.212750 22761 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:41895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:44193
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:44193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:03.213780 22761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:03.214818 22761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:03.223438 22774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:03.223471 22768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:03.223588 22761 server_base.cc:1034] running on GCE node
W20260811 11:45:03.223443 22767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:03.224277 22761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:03.225468 22761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:03.226662 22761 hybrid_clock.cc:648] HybridClock initialized: now 1786448703226643 us; error 38 us; skew 500 ppm
Aug 11 11:45:03 dist-test-slave-vkjp krb5kdc[22742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448703, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:03.232729 22761 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:45:03.233668 22761 webserver.cc:460] Webserver started at http://127.20.244.126:38555/ using document root <none> and password file <none>
I20260811 11:45:03.234257 22761 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:03.234351 22761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:03.234603 22761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:03.236869 22761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "ec565fa2d6f143679e4c52c8c8c78a49"
format_stamp: "Formatted at 2026-08-11 11:45:03 on dist-test-slave-vkjp"
server_key: "6f04782f7a215cb96d92e0ff32cab015"
server_key_iv: "e5ad16c83ae38f3b7ddc12836ca85b44"
server_key_version: "encryptionkey@0"
I20260811 11:45:03.237478 22761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "ec565fa2d6f143679e4c52c8c8c78a49"
format_stamp: "Formatted at 2026-08-11 11:45:03 on dist-test-slave-vkjp"
server_key: "6f04782f7a215cb96d92e0ff32cab015"
server_key_iv: "e5ad16c83ae38f3b7ddc12836ca85b44"
server_key_version: "encryptionkey@0"
I20260811 11:45:03.241637 22761 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 11:45:03.244226 22782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:03.245469 22761 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:45:03.245617 22761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "ec565fa2d6f143679e4c52c8c8c78a49"
format_stamp: "Formatted at 2026-08-11 11:45:03 on dist-test-slave-vkjp"
server_key: "6f04782f7a215cb96d92e0ff32cab015"
server_key_iv: "e5ad16c83ae38f3b7ddc12836ca85b44"
server_key_version: "encryptionkey@0"
I20260811 11:45:03.245740 22761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:03.274972 22761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:03.278359 22761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:03.278595 22761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:03.287317 22761 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:44193
I20260811 11:45:03.287379 22857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:44193 every 8 connection(s)
I20260811 11:45:03.288313 22761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:45:03.291193 22858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:03.296597 22858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49: Bootstrap starting.
I20260811 11:45:03.296976 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 22761
I20260811 11:45:03.297106 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:45:03.297359 21457 external_mini_cluster.cc:1428] Setting key 452e5205500b769347b8cad518e09a3f
I20260811 11:45:03.299301 22858 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:03.300187 22858 log.cc:824] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:03.302155 22858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49: No bootstrap required, opened a new log
I20260811 11:45:03.305693 22858 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec565fa2d6f143679e4c52c8c8c78a49" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 44193 } }
I20260811 11:45:03.305974 22858 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:03.306037 22858 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec565fa2d6f143679e4c52c8c8c78a49, State: Initialized, Role: FOLLOWER
Aug 11 11:45:03 dist-test-slave-vkjp krb5kdc[22742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448703, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:03.306535 22858 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec565fa2d6f143679e4c52c8c8c78a49" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 44193 } }
I20260811 11:45:03.306703 22858 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:45:03.306783 22858 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:45:03.306888 22858 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:03.307983 22858 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec565fa2d6f143679e4c52c8c8c78a49" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 44193 } }
I20260811 11:45:03.308362 22858 leader_election.cc:302] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec565fa2d6f143679e4c52c8c8c78a49; no voters:
I20260811 11:45:03.308712 22858 leader_election.cc:288] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:45:03.308835 22864 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:03.309058 22864 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49 [term 1 LEADER]: Becoming Leader. State: Replica: ec565fa2d6f143679e4c52c8c8c78a49, State: Running, Role: LEADER
I20260811 11:45:03.309907 22864 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec565fa2d6f143679e4c52c8c8c78a49" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 44193 } }
I20260811 11:45:03.309949 22858 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:45:03.311770 22865 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec565fa2d6f143679e4c52c8c8c78a49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec565fa2d6f143679e4c52c8c8c78a49" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 44193 } } }
I20260811 11:45:03.311933 22865 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:03.312515 22866 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec565fa2d6f143679e4c52c8c8c78a49. Latest consensus state: current_term: 1 leader_uuid: "ec565fa2d6f143679e4c52c8c8c78a49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec565fa2d6f143679e4c52c8c8c78a49" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 44193 } } }
I20260811 11:45:03.312718 22866 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:03.313014 22881 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:45:03.313418 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:03.298777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49958 (local address 127.20.244.126:44193)
0811 11:45:03.299276 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:03.299297 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:03.299341 (+ 44us) server_negotiation.cc:407] Connection header received
0811 11:45:03.300187 (+ 846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:03.300212 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:03.300627 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:03.301005 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:03.301808 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:03.302940 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:03.303845 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:03.304339 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:03.304514 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:03.307184 (+ 2670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:03.307197 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:03.307209 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:03.307236 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:03.309266 (+ 2030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:03.309773 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:03.309779 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:03.309785 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:03.309936 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:03.310315 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:03.310318 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:03.310320 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:03.310829 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:03.311012 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:03.311932 (+ 920us) server_negotiation.cc:299] Negotiation successful
0811 11:45:03.312228 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":117,"threads_started":1}
I20260811 11:45:03.315985 22881 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:45:03.321535 22881 catalog_manager.cc:1347] Generated new cluster ID: 756242f8c1b54746ac50d9338426c33e
I20260811 11:45:03.321600 22881 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:45:03.369019 22881 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:45:03.370467 22881 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:45:03.379630 22881 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49: Generated new TSK 0
I20260811 11:45:03.380450 22881 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.244.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
I20260811 11:45:03.414534 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:44193
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:41895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:03.528405 22889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:03.528643 22889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:03.528685 22889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:03.532902 22889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:03.532960 22889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:03.532998 22889 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 11:45:03.533030 22889 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:45:03.538098 22889 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:41895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.244.126:44193
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22889
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:03.539054 22889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:03.540081 22889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:03.549598 22896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:03.549576 22895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:03.549584 22898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:03.549762 22889 server_base.cc:1034] running on GCE node
I20260811 11:45:03.550298 22889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:03.550956 22889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:03.552136 22889 hybrid_clock.cc:648] HybridClock initialized: now 1786448703552113 us; error 45 us; skew 500 ppm
Aug 11 11:45:03 dist-test-slave-vkjp krb5kdc[22742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448703, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:03.554782 22889 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:45:03.555709 22889 webserver.cc:460] Webserver started at http://127.20.244.65:38493/ using document root <none> and password file <none>
I20260811 11:45:03.556273 22889 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:03.556362 22889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:03.556597 22889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:03.558703 22889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "ea9b9680450b427a9e26507ddc258680"
format_stamp: "Formatted at 2026-08-11 11:45:03 on dist-test-slave-vkjp"
server_key: "f96f19cc4b9594932cd45ca0ecb2fe95"
server_key_iv: "89437ac04023d00f05db5afc02942f7e"
server_key_version: "encryptionkey@0"
I20260811 11:45:03.559324 22889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "ea9b9680450b427a9e26507ddc258680"
format_stamp: "Formatted at 2026-08-11 11:45:03 on dist-test-slave-vkjp"
server_key: "f96f19cc4b9594932cd45ca0ecb2fe95"
server_key_iv: "89437ac04023d00f05db5afc02942f7e"
server_key_version: "encryptionkey@0"
I20260811 11:45:03.562927 22889 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:45:03.565274 22906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:03.566452 22889 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:03.566581 22889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "ea9b9680450b427a9e26507ddc258680"
format_stamp: "Formatted at 2026-08-11 11:45:03 on dist-test-slave-vkjp"
server_key: "f96f19cc4b9594932cd45ca0ecb2fe95"
server_key_iv: "89437ac04023d00f05db5afc02942f7e"
server_key_version: "encryptionkey@0"
I20260811 11:45:03.566687 22889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:03.580662 22889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:03.583388 22889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:03.583580 22889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:03.584975 22889 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:03.585047 22889 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:03.585119 22889 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:03.585160 22889 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:03.597819 22889 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:39617
Aug 11 11:45:03 dist-test-slave-vkjp krb5kdc[22742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448703, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:03.598433 23043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:39617 every 8 connection(s)
I20260811 11:45:03.598845 22889 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:45:03.601217 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 22889
I20260811 11:45:03.601358 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:45:03.601691 21457 external_mini_cluster.cc:1428] Setting key d34533e661bfbeb906fe768ac698d4bf
I20260811 11:45:03.602906 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:03.585885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:32877 (local address 127.20.244.126:44193)
0811 11:45:03.586019 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:03.586023 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:03.587387 (+ 1364us) server_negotiation.cc:407] Connection header received
0811 11:45:03.588857 (+ 1470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:03.588862 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:03.588944 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:03.589008 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:03.590843 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:03.592136 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:03.594679 (+ 2543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:03.595526 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:03.595645 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:03.599120 (+ 3475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:03.599125 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:03.599128 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:03.599161 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:03.600666 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:03.601175 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:03.601180 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:03.601182 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:03.601286 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:03.601723 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:03.601726 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:03.601727 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:03.601958 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:03.602036 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:03.602604 (+ 568us) server_negotiation.cc:299] Negotiation successful
0811 11:45:03.602734 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 11:45:03.603928 22916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:03.586420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:44193 (local address 127.20.244.65:32877)
0811 11:45:03.587139 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:03.587230 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:03.588580 (+ 1350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:03.589438 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:03.589450 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:03.589944 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:03.590627 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:03.590650 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:03.592308 (+ 1658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:03.592311 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:03.594456 (+ 2145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:03.594471 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:03.595881 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:03.595888 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:03.596142 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:03.596904 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:03.596934 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:03.598838 (+ 1904us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:03.600777 (+ 1939us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:03.600782 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:03.600793 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:03.601068 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:03.601417 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:03.601422 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:03.601424 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:03.601616 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:03.602109 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:03.602116 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:03.602348 (+ 232us) client_negotiation.cc:769] Sending connection context
0811 11:45:03.602543 (+ 195us) client_negotiation.cc:240] Negotiation successful
0811 11:45:03.602870 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":143,"threads_started":1}
I20260811 11:45:03.606823 23045 heartbeater.cc:347] Connected to a master server at 127.20.244.126:44193
I20260811 11:45:03.606992 23045 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:03.607595 23045 heartbeater.cc:511] Master 127.20.244.126:44193 requested a full tablet report, sending...
I20260811 11:45:03.609365 22801 ts_manager.cc:194] Registered new tserver with Master: ea9b9680450b427a9e26507ddc258680 (127.20.244.65:39617)
I20260811 11:45:03.610913 22801 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:32877
WARNING: no policy specified for kudu/127.20.244.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.66@KRBTEST.COM" created.
I20260811 11:45:03.619071 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:03.609086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:43591 (local address 127.20.244.126:44193)
0811 11:45:03.609214 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:03.609218 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:03.611363 (+ 2145us) server_negotiation.cc:407] Connection header received
0811 11:45:03.611562 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:03.611565 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:03.611621 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:03.611750 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:03.612298 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:03.613032 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:03.614059 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:03.614327 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:03.614459 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:03.615531 (+ 1072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:03.615534 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:03.615537 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:03.615561 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:03.617261 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:03.617722 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:03.617729 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:03.617734 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:03.617838 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:03.618121 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:03.618127 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:03.618132 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:03.618418 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:03.618534 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:03.618796 (+ 262us) server_negotiation.cc:299] Negotiation successful
0811 11:45:03.618916 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 11:45:03.619109 23053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:03.609028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:44193 (local address 127.20.244.65:43591)
0811 11:45:03.611274 (+ 2246us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:03.611291 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:03.611443 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:03.611756 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:03.611762 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:03.611998 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:03.612147 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:03.612159 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:03.613191 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:03.613198 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:03.613941 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:03.613951 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:03.614455 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:03.614458 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:03.614526 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:03.614998 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:03.615009 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:03.615379 (+ 370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:03.617424 (+ 2045us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:03.617427 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:03.617428 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:03.617618 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:03.617948 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:03.617950 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:03.617951 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:03.618027 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:03.618527 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:03.618529 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:03.618610 (+ 81us) client_negotiation.cc:769] Sending connection context
0811 11:45:03.618732 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 11:45:03.618880 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2149,"thread_start_us":110,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
I20260811 11:45:03.634775 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:44193
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:41895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:03.747248 23055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:03.747535 23055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:03.747612 23055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:03.751672 23055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:03.751752 23055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:03.751825 23055 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 11:45:03.751905 23055 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:45:03.757166 23055 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:41895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.244.126:44193
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23055
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:03.758260 23055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:03.759351 23055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:03.768959 23062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:03.768946 23061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:03.768941 23064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:03.769203 23055 server_base.cc:1034] running on GCE node
I20260811 11:45:03.769791 23055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:03.770442 23055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:03.771622 23055 hybrid_clock.cc:648] HybridClock initialized: now 1786448703771597 us; error 44 us; skew 500 ppm
Aug 11 11:45:03 dist-test-slave-vkjp krb5kdc[22742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448703, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:03.774264 23055 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:45:03.775055 23055 webserver.cc:460] Webserver started at http://127.20.244.66:35437/ using document root <none> and password file <none>
I20260811 11:45:03.775627 23055 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:03.775686 23055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:03.775849 23055 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:03.777873 23055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "f860632877484be8b0bb29557b9c45cc"
format_stamp: "Formatted at 2026-08-11 11:45:03 on dist-test-slave-vkjp"
server_key: "fd1b521ef1736a0a2658dedd71f38f4f"
server_key_iv: "3b7972a9cce7fa54dfb80e4099736e29"
server_key_version: "encryptionkey@0"
I20260811 11:45:03.778378 23055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "f860632877484be8b0bb29557b9c45cc"
format_stamp: "Formatted at 2026-08-11 11:45:03 on dist-test-slave-vkjp"
server_key: "fd1b521ef1736a0a2658dedd71f38f4f"
server_key_iv: "3b7972a9cce7fa54dfb80e4099736e29"
server_key_version: "encryptionkey@0"
I20260811 11:45:03.782014 23055 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260811 11:45:03.784343 23073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:03.785625 23055 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 11:45:03.785743 23055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "f860632877484be8b0bb29557b9c45cc"
format_stamp: "Formatted at 2026-08-11 11:45:03 on dist-test-slave-vkjp"
server_key: "fd1b521ef1736a0a2658dedd71f38f4f"
server_key_iv: "3b7972a9cce7fa54dfb80e4099736e29"
server_key_version: "encryptionkey@0"
I20260811 11:45:03.785835 23055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:03.801040 23055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:03.804064 23055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:03.804279 23055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:03.805725 23055 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:03.805775 23055 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:03.805840 23055 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:03.805873 23055 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 11:45:03 dist-test-slave-vkjp krb5kdc[22742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448703, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:03.817911 23055 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:33043
I20260811 11:45:03.818287 23218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:33043 every 8 connection(s)
I20260811 11:45:03.818936 23055 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:45:03.821381 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:03.806606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:35971 (local address 127.20.244.126:44193)
0811 11:45:03.806803 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:03.806810 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:03.807721 (+ 911us) server_negotiation.cc:407] Connection header received
0811 11:45:03.809037 (+ 1316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:03.809041 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:03.809112 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:03.809231 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:03.810409 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:03.811271 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:03.813146 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:03.813427 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:03.813546 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:03.817278 (+ 3732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:03.817281 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:03.817283 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:03.817309 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:03.818963 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:03.819673 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:03.819680 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:03.819682 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:03.819780 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:03.820242 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:03.820247 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:03.820252 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:03.820506 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:03.820619 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:03.821158 (+ 539us) server_negotiation.cc:299] Negotiation successful
0811 11:45:03.821264 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 11:45:03.821884 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 23055
I20260811 11:45:03.821988 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:45:03.822227 23085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:03.806995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:44193 (local address 127.20.244.66:35971)
0811 11:45:03.807541 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:03.807603 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:03.808723 (+ 1120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:03.809408 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:03.809414 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:03.809732 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:03.810263 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:03.810278 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:03.811447 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:03.811450 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:03.813016 (+ 1566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:03.813027 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:03.813603 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:03.813608 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:03.813826 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:03.814434 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:03.814453 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:03.817105 (+ 2652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:03.819141 (+ 2036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:03.819147 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:03.819161 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:03.819536 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:03.819890 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:03.819894 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:03.819896 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:03.820118 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:03.820612 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:03.820617 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:03.820882 (+ 265us) client_negotiation.cc:769] Sending connection context
0811 11:45:03.821045 (+ 163us) client_negotiation.cc:240] Negotiation successful
0811 11:45:03.821292 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":113,"threads_started":1}
I20260811 11:45:03.822273 21457 external_mini_cluster.cc:1428] Setting key d7317834db5940200c72f4f75bd9a565
I20260811 11:45:03.823589 23219 heartbeater.cc:347] Connected to a master server at 127.20.244.126:44193
I20260811 11:45:03.823774 23219 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:03.824393 23219 heartbeater.cc:511] Master 127.20.244.126:44193 requested a full tablet report, sending...
I20260811 11:45:03.825498 22800 ts_manager.cc:194] Registered new tserver with Master: f860632877484be8b0bb29557b9c45cc (127.20.244.66:33043)
I20260811 11:45:03.826336 22800 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:35971
I20260811 11:45:03.833751 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:03.825935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:50493 (local address 127.20.244.126:44193)
0811 11:45:03.826059 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:03.826064 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:03.826373 (+ 309us) server_negotiation.cc:407] Connection header received
0811 11:45:03.826484 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:03.826486 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:03.826524 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:03.826620 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:03.827232 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:03.828034 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:03.828881 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:03.829089 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:03.829172 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:03.830442 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:03.830445 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:03.830447 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:03.830468 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:03.832046 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:03.832576 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:03.832579 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:03.832580 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:03.832654 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:03.832959 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:03.832961 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:03.832962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:03.833152 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:03.833228 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:03.833546 (+ 318us) server_negotiation.cc:299] Negotiation successful
0811 11:45:03.833642 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 11:45:03.833881 23229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:03.826010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:44193 (local address 127.20.244.66:50493)
0811 11:45:03.826239 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:03.826253 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:03.826399 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:03.826656 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:03.826661 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:03.826902 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:03.827059 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:03.827067 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:03.828209 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:03.828215 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:03.828772 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:03.828780 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:03.829208 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:03.829215 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:03.829344 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:03.829835 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:03.829854 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:03.830300 (+ 446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:03.832165 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:03.832171 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:03.832176 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:03.832471 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:03.832751 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:03.832757 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:03.832761 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:03.832862 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:03.833254 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:03.833257 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:03.833360 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 11:45:03.833497 (+ 137us) client_negotiation.cc:240] Negotiation successful
0811 11:45:03.833659 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":78,"threads_started":1}
WARNING: no policy specified for kudu/127.20.244.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
I20260811 11:45:03.854558 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:44193
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:41895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:03.969982 23231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:03.970219 23231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:03.970304 23231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:03.974313 23231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:03.974370 23231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:03.974406 23231 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 11:45:03.974491 23231 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:45:03.979779 23231 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:41895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.244.126:44193
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23231
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:03.980793 23231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:03.981815 23231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:03.991473 23237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:03.991525 23238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:03.991521 23243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:03.991681 23231 server_base.cc:1034] running on GCE node
I20260811 11:45:03.992239 23231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:03.992892 23231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:03.994081 23231 hybrid_clock.cc:648] HybridClock initialized: now 1786448703994057 us; error 34 us; skew 500 ppm
Aug 11 11:45:03 dist-test-slave-vkjp krb5kdc[22742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448703, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:03.996886 23231 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:45:03.997756 23231 webserver.cc:460] Webserver started at http://127.20.244.67:35613/ using document root <none> and password file <none>
I20260811 11:45:03.998299 23231 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:03.998368 23231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:03.998538 23231 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:04.000648 23231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "299fc50a61734282a3fc955e91456aa2"
format_stamp: "Formatted at 2026-08-11 11:45:03 on dist-test-slave-vkjp"
server_key: "07279545c23ad6345b2c338a451f4b99"
server_key_iv: "2e6f4139117a1de1266342489410650c"
server_key_version: "encryptionkey@0"
I20260811 11:45:04.001212 23231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "299fc50a61734282a3fc955e91456aa2"
format_stamp: "Formatted at 2026-08-11 11:45:03 on dist-test-slave-vkjp"
server_key: "07279545c23ad6345b2c338a451f4b99"
server_key_iv: "2e6f4139117a1de1266342489410650c"
server_key_version: "encryptionkey@0"
I20260811 11:45:04.004994 23231 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 11:45:04.007642 23252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:04.008884 23231 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:45:04.009040 23231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "299fc50a61734282a3fc955e91456aa2"
format_stamp: "Formatted at 2026-08-11 11:45:03 on dist-test-slave-vkjp"
server_key: "07279545c23ad6345b2c338a451f4b99"
server_key_iv: "2e6f4139117a1de1266342489410650c"
server_key_version: "encryptionkey@0"
I20260811 11:45:04.009136 23231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:04.030220 23231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:04.033607 23231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:04.033758 23231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:04.035387 23231 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:04.035460 23231 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:04.035573 23231 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:04.035609 23231 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 11:45:04 dist-test-slave-vkjp krb5kdc[22742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448703, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:04.046955 23231 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:40007
I20260811 11:45:04.047037 23393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:40007 every 8 connection(s)
I20260811 11:45:04.048091 23231 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:45:04.049549 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.036044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:40623 (local address 127.20.244.126:44193)
0811 11:45:04.036199 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:04.036206 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:04.037526 (+ 1320us) server_negotiation.cc:407] Connection header received
0811 11:45:04.038827 (+ 1301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:04.038831 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:04.038898 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:04.039005 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:04.040323 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.040860 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.042094 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.042363 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.042489 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.045405 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:04.045411 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:04.045414 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:04.045443 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:04.047206 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:04.047755 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:04.047758 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:04.047759 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:04.047835 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:04.048211 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:04.048214 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:04.048216 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:04.048410 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:04.048574 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:04.049260 (+ 686us) server_negotiation.cc:299] Negotiation successful
0811 11:45:04.049410 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 11:45:04.050333 23264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.036896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:44193 (local address 127.20.244.67:40623)
0811 11:45:04.037351 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:04.037402 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:04.038557 (+ 1155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:04.039243 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:04.039250 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:04.039692 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:04.040172 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.040184 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.041013 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.041016 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.041958 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.041968 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.042538 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.042542 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.042745 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.043347 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:04.043366 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:04.045188 (+ 1822us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:04.047321 (+ 2133us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:04.047326 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:04.047338 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:04.047657 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:04.047923 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:04.047926 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:04.047928 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:04.048105 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:04.048596 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:04.048605 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:04.048938 (+ 333us) client_negotiation.cc:769] Sending connection context
0811 11:45:04.049151 (+ 213us) client_negotiation.cc:240] Negotiation successful
0811 11:45:04.049434 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":137,"threads_started":1}
I20260811 11:45:04.051469 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 23231
I20260811 11:45:04.051600 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:45:04.051877 21457 external_mini_cluster.cc:1428] Setting key 2d0dbf6fe810fc1e710619a06f3561b3
I20260811 11:45:04.052210 23394 heartbeater.cc:347] Connected to a master server at 127.20.244.126:44193
I20260811 11:45:04.052368 23394 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:04.052944 23394 heartbeater.cc:511] Master 127.20.244.126:44193 requested a full tablet report, sending...
I20260811 11:45:04.054123 22800 ts_manager.cc:194] Registered new tserver with Master: 299fc50a61734282a3fc955e91456aa2 (127.20.244.67:40007)
I20260811 11:45:04.054705 22800 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:40623
I20260811 11:45:04.060792 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.053867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:40567 (local address 127.20.244.126:44193)
0811 11:45:04.053975 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:04.053979 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:04.054246 (+ 267us) server_negotiation.cc:407] Connection header received
0811 11:45:04.054361 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:04.054364 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:04.054406 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:04.054505 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:04.054961 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.055721 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.056594 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.056861 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.056946 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.057919 (+ 973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:04.057922 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:04.057925 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:04.057947 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:04.059502 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:04.059879 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:04.059882 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:04.059883 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:04.059956 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:04.060180 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:04.060183 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:04.060184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:04.060339 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:04.060414 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:04.060602 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 11:45:04.060685 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 11:45:04.060863 23400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.053809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:44193 (local address 127.20.244.67:40567)
0811 11:45:04.054158 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:04.054170 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:04.054284 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:04.054520 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:04.054523 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:04.054722 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:04.054839 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.054849 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.055876 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.055879 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.056469 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.056478 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.056963 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.056965 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.057033 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.057465 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:04.057476 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:04.057786 (+ 310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:04.059606 (+ 1820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:04.059609 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:04.059610 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:04.059789 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:04.060032 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:04.060034 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:04.060036 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:04.060104 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:04.060420 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:04.060422 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:04.060492 (+ 70us) client_negotiation.cc:769] Sending connection context
0811 11:45:04.060571 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 11:45:04.060668 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":117,"threads_started":1}
I20260811 11:45:04.065744 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 11:45:04 dist-test-slave-vkjp krb5kdc[22742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448704, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 11:45:04 dist-test-slave-vkjp krb5kdc[22742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448704, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:04.092298 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.084259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49964 (local address 127.20.244.126:44193)
0811 11:45:04.084389 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:04.084393 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:04.084405 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:45:04.084451 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:04.084453 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:04.084494 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:04.084575 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:04.085257 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.085768 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.086564 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.086772 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.086844 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.089200 (+ 2356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:04.089203 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:04.089205 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:04.089230 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:04.090729 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:04.091250 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:04.091253 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:04.091254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:04.091332 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:04.091600 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:04.091602 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:04.091604 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:04.091773 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:04.091921 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:04.092080 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 11:45:04.092173 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 11:45:04.095546 22800 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49964:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:45:04.098598 22800 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:45:04.113749 23413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.107267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:33043 (local address 127.0.0.1:50170)
0811 11:45:04.108110 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:04.108163 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:04.108295 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:04.108975 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:04.108980 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:04.109000 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:04.109143 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.109149 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.110490 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.110497 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.111919 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.111939 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.113119 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.113123 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.113257 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.113311 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 11:45:04.113438 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 11:45:04.113564 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"mutex_wait_us":20,"thread_start_us":84,"threads_started":1}
I20260811 11:45:04.113878 23417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.108023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:39617 (local address 127.0.0.1:36884)
0811 11:45:04.108853 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:04.108871 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:04.108970 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:04.109790 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:04.109793 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:04.109813 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:04.109890 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.109896 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.111302 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.111306 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.112406 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.112415 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.113446 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.113450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.113535 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.113558 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 11:45:04.113625 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 11:45:04.113684 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":766,"mutex_wait_us":2,"thread_start_us":103,"threads_started":1}
I20260811 11:45:04.114473 23414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.107374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50170 (local address 127.20.244.66:33043)
0811 11:45:04.107952 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:04.107968 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:04.108457 (+ 489us) server_negotiation.cc:407] Connection header received
0811 11:45:04.108549 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:04.108554 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:04.108772 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:04.108926 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:04.109263 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.110376 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.112062 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.112968 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.113106 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.113285 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:04.113993 (+ 708us) server_negotiation.cc:299] Negotiation successful
0811 11:45:04.114094 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":131,"threads_started":1}
I20260811 11:45:04.114579 23418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.107472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:40007 (local address 127.0.0.1:36406)
0811 11:45:04.108736 (+ 1264us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:04.108751 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:04.108838 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:04.109293 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:04.109296 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:04.109318 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:04.109405 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.109410 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.111554 (+ 2144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.111560 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.112669 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.112682 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.114066 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.114070 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.114155 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.114176 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 11:45:04.114248 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 11:45:04.114317 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1202,"thread_start_us":87,"threads_started":1}
I20260811 11:45:04.114912 23420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.108232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36884 (local address 127.20.244.65:39617)
0811 11:45:04.109271 (+ 1039us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:04.109278 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:04.109302 (+ 24us) server_negotiation.cc:407] Connection header received
0811 11:45:04.109380 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:04.109385 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:04.109560 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:04.109805 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:04.110020 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.111174 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.112527 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.113311 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.113481 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.113615 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:04.113670 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 11:45:04.113762 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":897,"thread_start_us":83,"threads_started":1}
I20260811 11:45:04.115130 23421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.108406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36406 (local address 127.20.244.67:40007)
0811 11:45:04.108835 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:04.108848 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:04.108877 (+ 29us) server_negotiation.cc:407] Connection header received
0811 11:45:04.108966 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:04.108971 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:04.109152 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:04.109311 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:04.109499 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.111410 (+ 1911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.112862 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.113722 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.113824 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.113998 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:04.114857 (+ 859us) server_negotiation.cc:299] Negotiation successful
0811 11:45:04.114963 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":143,"threads_started":1}
I20260811 11:45:04.117620 23318 tablet_service.cc:1467] Processing CreateTablet for tablet d4d84862810b48a087fc079937af0a26 (DEFAULT_TABLE table=test-table [id=721c34ac7a434b509b48738cc227400c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:04.117719 22966 tablet_service.cc:1467] Processing CreateTablet for tablet d4d84862810b48a087fc079937af0a26 (DEFAULT_TABLE table=test-table [id=721c34ac7a434b509b48738cc227400c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:04.117722 23135 tablet_service.cc:1467] Processing CreateTablet for tablet d4d84862810b48a087fc079937af0a26 (DEFAULT_TABLE table=test-table [id=721c34ac7a434b509b48738cc227400c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:04.118716 22966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4d84862810b48a087fc079937af0a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:04.118716 23135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4d84862810b48a087fc079937af0a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:04.118737 23318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4d84862810b48a087fc079937af0a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:04.125717 23422 tablet_bootstrap.cc:492] T d4d84862810b48a087fc079937af0a26 P 299fc50a61734282a3fc955e91456aa2: Bootstrap starting.
I20260811 11:45:04.126395 23424 tablet_bootstrap.cc:492] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc: Bootstrap starting.
I20260811 11:45:04.127449 23423 tablet_bootstrap.cc:492] T d4d84862810b48a087fc079937af0a26 P ea9b9680450b427a9e26507ddc258680: Bootstrap starting.
I20260811 11:45:04.128760 23422 tablet_bootstrap.cc:654] T d4d84862810b48a087fc079937af0a26 P 299fc50a61734282a3fc955e91456aa2: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:04.128760 23424 tablet_bootstrap.cc:654] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:04.129320 23423 tablet_bootstrap.cc:654] T d4d84862810b48a087fc079937af0a26 P ea9b9680450b427a9e26507ddc258680: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:04.129688 23422 log.cc:824] T d4d84862810b48a087fc079937af0a26 P 299fc50a61734282a3fc955e91456aa2: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:04.129688 23424 log.cc:824] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:04.130061 23423 log.cc:824] T d4d84862810b48a087fc079937af0a26 P ea9b9680450b427a9e26507ddc258680: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:04.131904 23424 tablet_bootstrap.cc:492] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc: No bootstrap required, opened a new log
I20260811 11:45:04.131920 23422 tablet_bootstrap.cc:492] T d4d84862810b48a087fc079937af0a26 P 299fc50a61734282a3fc955e91456aa2: No bootstrap required, opened a new log
I20260811 11:45:04.131938 23423 tablet_bootstrap.cc:492] T d4d84862810b48a087fc079937af0a26 P ea9b9680450b427a9e26507ddc258680: No bootstrap required, opened a new log
I20260811 11:45:04.132108 23422 ts_tablet_manager.cc:1397] T d4d84862810b48a087fc079937af0a26 P 299fc50a61734282a3fc955e91456aa2: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 11:45:04.132108 23423 ts_tablet_manager.cc:1397] T d4d84862810b48a087fc079937af0a26 P ea9b9680450b427a9e26507ddc258680: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 11:45:04.132110 23424 ts_tablet_manager.cc:1397] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 11:45:04.135010 23424 raft_consensus.cc:348] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } } peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } }
I20260811 11:45:04.135317 23424 raft_consensus.cc:374] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:04.135381 23424 raft_consensus.cc:729] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f860632877484be8b0bb29557b9c45cc, State: Initialized, Role: FOLLOWER
I20260811 11:45:04.135878 23424 consensus_queue.cc:260] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } } peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } }
I20260811 11:45:04.136080 23422 raft_consensus.cc:348] T d4d84862810b48a087fc079937af0a26 P 299fc50a61734282a3fc955e91456aa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } } peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } }
I20260811 11:45:04.136355 23422 raft_consensus.cc:374] T d4d84862810b48a087fc079937af0a26 P 299fc50a61734282a3fc955e91456aa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:04.136404 23422 raft_consensus.cc:729] T d4d84862810b48a087fc079937af0a26 P 299fc50a61734282a3fc955e91456aa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 299fc50a61734282a3fc955e91456aa2, State: Initialized, Role: FOLLOWER
I20260811 11:45:04.136278 23423 raft_consensus.cc:348] T d4d84862810b48a087fc079937af0a26 P ea9b9680450b427a9e26507ddc258680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } } peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } }
I20260811 11:45:04.136503 23423 raft_consensus.cc:374] T d4d84862810b48a087fc079937af0a26 P ea9b9680450b427a9e26507ddc258680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:04.136554 23423 raft_consensus.cc:729] T d4d84862810b48a087fc079937af0a26 P ea9b9680450b427a9e26507ddc258680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea9b9680450b427a9e26507ddc258680, State: Initialized, Role: FOLLOWER
I20260811 11:45:04.136957 23424 ts_tablet_manager.cc:1428] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 11:45:04.136886 23422 consensus_queue.cc:260] T d4d84862810b48a087fc079937af0a26 P 299fc50a61734282a3fc955e91456aa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } } peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } }
I20260811 11:45:04.136914 23423 consensus_queue.cc:260] T d4d84862810b48a087fc079937af0a26 P ea9b9680450b427a9e26507ddc258680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } } peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } }
I20260811 11:45:04.137009 23219 heartbeater.cc:503] Master 127.20.244.126:44193 was elected leader, sending a full tablet report...
I20260811 11:45:04.137593 23394 heartbeater.cc:503] Master 127.20.244.126:44193 was elected leader, sending a full tablet report...
I20260811 11:45:04.137820 23423 ts_tablet_manager.cc:1428] T d4d84862810b48a087fc079937af0a26 P ea9b9680450b427a9e26507ddc258680: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 11:45:04.137918 23045 heartbeater.cc:503] Master 127.20.244.126:44193 was elected leader, sending a full tablet report...
I20260811 11:45:04.138520 23422 ts_tablet_manager.cc:1428] T d4d84862810b48a087fc079937af0a26 P 299fc50a61734282a3fc955e91456aa2: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260811 11:45:04.299409 23395 tablet.cc:2369] T d4d84862810b48a087fc079937af0a26 P 299fc50a61734282a3fc955e91456aa2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:45:04.321522 23222 tablet.cc:2369] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:45:04.350881 23046 tablet.cc:2369] T d4d84862810b48a087fc079937af0a26 P ea9b9680450b427a9e26507ddc258680: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:45:04.360867 23428 raft_consensus.cc:482] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:45:04.361105 23428 raft_consensus.cc:504] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } } peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } }
I20260811 11:45:04.362231 23428 leader_election.cc:288] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 299fc50a61734282a3fc955e91456aa2 (127.20.244.67:40007), ea9b9680450b427a9e26507ddc258680 (127.20.244.65:39617)
I20260811 11:45:04.367498 23420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.363056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:60037 (local address 127.20.244.65:39617)
0811 11:45:04.363237 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:04.363244 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:04.363343 (+ 99us) server_negotiation.cc:407] Connection header received
0811 11:45:04.363476 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:04.363479 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:04.363525 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:04.363616 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:04.363856 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.364579 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.366103 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.366721 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.366849 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.366901 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:04.367290 (+ 389us) server_negotiation.cc:299] Negotiation successful
0811 11:45:04.367366 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 11:45:04.367498 23421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.362646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:32859 (local address 127.20.244.67:40007)
0811 11:45:04.362793 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:04.362800 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:04.362894 (+ 94us) server_negotiation.cc:407] Connection header received
0811 11:45:04.363123 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:04.363130 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:04.363194 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:04.363296 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:04.363617 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.364417 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.366103 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.366721 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.366850 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.366901 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:04.367290 (+ 389us) server_negotiation.cc:299] Negotiation successful
0811 11:45:04.367365 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 11:45:04.367556 23434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.362933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:39617 (local address 127.20.244.66:60037)
0811 11:45:04.363230 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:04.363241 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:04.363367 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:04.363641 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:04.363643 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:04.363661 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:04.363745 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.363750 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.364677 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.364680 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.365969 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.365981 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.366862 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.366866 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.367115 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.367177 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 11:45:04.367258 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 11:45:04.367366 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":176,"spinlock_wait_cycles":6144,"thread_start_us":64,"threads_started":1}
I20260811 11:45:04.367570 23433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.362499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:40007 (local address 127.20.244.66:32859)
0811 11:45:04.362792 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:04.362808 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:04.362950 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:04.363325 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:04.363328 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:04.363356 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:04.363503 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.363508 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.364538 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.364541 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.365975 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.365981 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.366862 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.366866 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.367092 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.367180 (+ 88us) client_negotiation.cc:769] Sending connection context
0811 11:45:04.367258 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 11:45:04.367367 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":195,"spinlock_wait_cycles":896,"thread_start_us":80,"threads_started":1}
I20260811 11:45:04.368301 23343 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4d84862810b48a087fc079937af0a26" candidate_uuid: "f860632877484be8b0bb29557b9c45cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "299fc50a61734282a3fc955e91456aa2" is_pre_election: true
I20260811 11:45:04.368333 22987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4d84862810b48a087fc079937af0a26" candidate_uuid: "f860632877484be8b0bb29557b9c45cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9b9680450b427a9e26507ddc258680" is_pre_election: true
I20260811 11:45:04.368609 23343 raft_consensus.cc:2454] T d4d84862810b48a087fc079937af0a26 P 299fc50a61734282a3fc955e91456aa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f860632877484be8b0bb29557b9c45cc in term 0.
I20260811 11:45:04.368619 22987 raft_consensus.cc:2454] T d4d84862810b48a087fc079937af0a26 P ea9b9680450b427a9e26507ddc258680 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f860632877484be8b0bb29557b9c45cc in term 0.
I20260811 11:45:04.369084 23078 leader_election.cc:302] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea9b9680450b427a9e26507ddc258680, f860632877484be8b0bb29557b9c45cc; no voters:
I20260811 11:45:04.369395 23428 raft_consensus.cc:2781] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:45:04.369472 23428 raft_consensus.cc:482] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:45:04.369501 23428 raft_consensus.cc:3037] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:04.370648 23428 raft_consensus.cc:504] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } } peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } }
I20260811 11:45:04.370983 23428 leader_election.cc:288] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc [CANDIDATE]: Term 1 election: Requested vote from peers 299fc50a61734282a3fc955e91456aa2 (127.20.244.67:40007), ea9b9680450b427a9e26507ddc258680 (127.20.244.65:39617)
I20260811 11:45:04.371388 23343 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4d84862810b48a087fc079937af0a26" candidate_uuid: "f860632877484be8b0bb29557b9c45cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "299fc50a61734282a3fc955e91456aa2"
I20260811 11:45:04.371464 22987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4d84862810b48a087fc079937af0a26" candidate_uuid: "f860632877484be8b0bb29557b9c45cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9b9680450b427a9e26507ddc258680"
I20260811 11:45:04.371521 23343 raft_consensus.cc:3037] T d4d84862810b48a087fc079937af0a26 P 299fc50a61734282a3fc955e91456aa2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:04.371577 22987 raft_consensus.cc:3037] T d4d84862810b48a087fc079937af0a26 P ea9b9680450b427a9e26507ddc258680 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:04.373015 22987 raft_consensus.cc:2454] T d4d84862810b48a087fc079937af0a26 P ea9b9680450b427a9e26507ddc258680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f860632877484be8b0bb29557b9c45cc in term 1.
I20260811 11:45:04.373322 23078 leader_election.cc:302] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea9b9680450b427a9e26507ddc258680, f860632877484be8b0bb29557b9c45cc; no voters:
I20260811 11:45:04.373515 23428 raft_consensus.cc:2781] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:04.373567 23343 raft_consensus.cc:2454] T d4d84862810b48a087fc079937af0a26 P 299fc50a61734282a3fc955e91456aa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f860632877484be8b0bb29557b9c45cc in term 1.
I20260811 11:45:04.373736 23428 raft_consensus.cc:686] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc [term 1 LEADER]: Becoming Leader. State: Replica: f860632877484be8b0bb29557b9c45cc, State: Running, Role: LEADER
I20260811 11:45:04.374112 23428 consensus_queue.cc:237] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } } peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } }
I20260811 11:45:04.377156 22801 catalog_manager.cc:5495] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc reported cstate change: term changed from 0 to 1, leader changed from <none> to f860632877484be8b0bb29557b9c45cc (127.20.244.66). New cstate: current_term: 1 leader_uuid: "f860632877484be8b0bb29557b9c45cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } health_report { overall_health: UNKNOWN } } }
I20260811 11:45:04.410898 23414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.407267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50178 (local address 127.20.244.66:33043)
0811 11:45:04.407441 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:04.407445 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:04.407460 (+ 15us) server_negotiation.cc:407] Connection header received
0811 11:45:04.407675 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:04.407678 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:04.407736 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:04.407821 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:45:04.408056 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.408580 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.409430 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.409637 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.409715 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.409997 (+ 282us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:45:04.410454 (+ 457us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:45:04.410573 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:04.410678 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 11:45:04.410730 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 11:45:04.417598 23343 raft_consensus.cc:1261] T d4d84862810b48a087fc079937af0a26 P 299fc50a61734282a3fc955e91456aa2 [term 1 FOLLOWER]: Refusing update from remote peer f860632877484be8b0bb29557b9c45cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:04.417598 22987 raft_consensus.cc:1261] T d4d84862810b48a087fc079937af0a26 P ea9b9680450b427a9e26507ddc258680 [term 1 FOLLOWER]: Refusing update from remote peer f860632877484be8b0bb29557b9c45cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:04.418313 23428 consensus_queue.cc:1035] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:04.418624 23435 consensus_queue.cc:1035] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:04.426034 23439 mvcc.cc:205] Tried to move back new op lower bound from 7317293893285216256 to 7317293893119283200. Current Snapshot: MvccSnapshot[applied={T|T < 7317293893285216256}]
I20260811 11:45:04.428913 23440 mvcc.cc:205] Tried to move back new op lower bound from 7317293893285216256 to 7317293893119283200. Current Snapshot: MvccSnapshot[applied={T|T < 7317293893285216256}]
I20260811 11:45:04.443429 22802 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49964:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:04.443666 22802 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49964:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:04.446489 22802 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49: Sending DeleteTablet for 3 replicas of tablet d4d84862810b48a087fc079937af0a26
I20260811 11:45:04.447377 23135 tablet_service.cc:1514] Processing DeleteTablet for tablet d4d84862810b48a087fc079937af0a26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:04 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:50170
I20260811 11:45:04.447451 22966 tablet_service.cc:1514] Processing DeleteTablet for tablet d4d84862810b48a087fc079937af0a26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:04 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:36884
I20260811 11:45:04.447898 23450 tablet_replica.cc:330] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc: stopping tablet replica
I20260811 11:45:04.448009 23318 tablet_service.cc:1514] Processing DeleteTablet for tablet d4d84862810b48a087fc079937af0a26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:04 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:36406
I20260811 11:45:04.448377 23450 raft_consensus.cc:2229] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:45:04.448523 23451 tablet_replica.cc:330] T d4d84862810b48a087fc079937af0a26 P ea9b9680450b427a9e26507ddc258680: stopping tablet replica
I20260811 11:45:04.448807 23451 raft_consensus.cc:2229] T d4d84862810b48a087fc079937af0a26 P ea9b9680450b427a9e26507ddc258680 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:04.448946 23450 raft_consensus.cc:2258] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:04.448971 22802 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49964:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 11:45:04.449117 23451 raft_consensus.cc:2258] T d4d84862810b48a087fc079937af0a26 P ea9b9680450b427a9e26507ddc258680 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 11:45:04.449427 22802 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:45:04.449694 23453 tablet_replica.cc:330] T d4d84862810b48a087fc079937af0a26 P 299fc50a61734282a3fc955e91456aa2: stopping tablet replica
I20260811 11:45:04.450003 23453 raft_consensus.cc:2229] T d4d84862810b48a087fc079937af0a26 P 299fc50a61734282a3fc955e91456aa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:04.450289 23453 raft_consensus.cc:2258] T d4d84862810b48a087fc079937af0a26 P 299fc50a61734282a3fc955e91456aa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:04.451012 23450 ts_tablet_manager.cc:1905] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:04.451900 23453 ts_tablet_manager.cc:1905] T d4d84862810b48a087fc079937af0a26 P 299fc50a61734282a3fc955e91456aa2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:04.454247 23450 ts_tablet_manager.cc:1918] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:45:04.454427 23450 log.cc:1196] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/d4d84862810b48a087fc079937af0a26
I20260811 11:45:04.454766 23453 ts_tablet_manager.cc:1918] T d4d84862810b48a087fc079937af0a26 P 299fc50a61734282a3fc955e91456aa2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:45:04.454883 23453 log.cc:1196] T d4d84862810b48a087fc079937af0a26 P 299fc50a61734282a3fc955e91456aa2: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/d4d84862810b48a087fc079937af0a26
I20260811 11:45:04.455066 23450 ts_tablet_manager.cc:1939] T d4d84862810b48a087fc079937af0a26 P f860632877484be8b0bb29557b9c45cc: Deleting consensus metadata
I20260811 11:45:04.455224 23453 ts_tablet_manager.cc:1939] T d4d84862810b48a087fc079937af0a26 P 299fc50a61734282a3fc955e91456aa2: Deleting consensus metadata
I20260811 11:45:04.455552 22966 tablet_service.cc:1467] Processing CreateTablet for tablet 0dda8686bb6646ab937e3ba75b101484 (DEFAULT_TABLE table=test-table [id=693187fc2b724ae288484105b5e79e4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:04.455827 22966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dda8686bb6646ab937e3ba75b101484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:04.456586 23318 tablet_service.cc:1467] Processing CreateTablet for tablet 0dda8686bb6646ab937e3ba75b101484 (DEFAULT_TABLE table=test-table [id=693187fc2b724ae288484105b5e79e4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:04.456851 23318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dda8686bb6646ab937e3ba75b101484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:04.458285 23423 tablet_bootstrap.cc:492] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680: Bootstrap starting.
I20260811 11:45:04.458326 22786 catalog_manager.cc:4841] TS 299fc50a61734282a3fc955e91456aa2 (127.20.244.67:40007): tablet d4d84862810b48a087fc079937af0a26 (table test-table [id=721c34ac7a434b509b48738cc227400c]) successfully deleted
I20260811 11:45:04.458709 23422 tablet_bootstrap.cc:492] T 0dda8686bb6646ab937e3ba75b101484 P 299fc50a61734282a3fc955e91456aa2: Bootstrap starting.
I20260811 11:45:04.459388 23423 tablet_bootstrap.cc:654] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:04.459394 22784 catalog_manager.cc:4841] TS f860632877484be8b0bb29557b9c45cc (127.20.244.66:33043): tablet d4d84862810b48a087fc079937af0a26 (table test-table [id=721c34ac7a434b509b48738cc227400c]) successfully deleted
I20260811 11:45:04.459695 23422 tablet_bootstrap.cc:654] T 0dda8686bb6646ab937e3ba75b101484 P 299fc50a61734282a3fc955e91456aa2: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:04.459969 23135 tablet_service.cc:1467] Processing CreateTablet for tablet 0dda8686bb6646ab937e3ba75b101484 (DEFAULT_TABLE table=test-table [id=693187fc2b724ae288484105b5e79e4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:04.460237 23135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dda8686bb6646ab937e3ba75b101484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:04.461052 23422 tablet_bootstrap.cc:492] T 0dda8686bb6646ab937e3ba75b101484 P 299fc50a61734282a3fc955e91456aa2: No bootstrap required, opened a new log
I20260811 11:45:04.461135 23422 ts_tablet_manager.cc:1397] T 0dda8686bb6646ab937e3ba75b101484 P 299fc50a61734282a3fc955e91456aa2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 11:45:04.461561 23422 raft_consensus.cc:348] T 0dda8686bb6646ab937e3ba75b101484 P 299fc50a61734282a3fc955e91456aa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } }
I20260811 11:45:04.461664 23422 raft_consensus.cc:374] T 0dda8686bb6646ab937e3ba75b101484 P 299fc50a61734282a3fc955e91456aa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:04.461695 23422 raft_consensus.cc:729] T 0dda8686bb6646ab937e3ba75b101484 P 299fc50a61734282a3fc955e91456aa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 299fc50a61734282a3fc955e91456aa2, State: Initialized, Role: FOLLOWER
I20260811 11:45:04.461704 23451 ts_tablet_manager.cc:1905] T d4d84862810b48a087fc079937af0a26 P ea9b9680450b427a9e26507ddc258680: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:04.461817 23422 consensus_queue.cc:260] T 0dda8686bb6646ab937e3ba75b101484 P 299fc50a61734282a3fc955e91456aa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } }
I20260811 11:45:04.462090 23422 ts_tablet_manager.cc:1428] T 0dda8686bb6646ab937e3ba75b101484 P 299fc50a61734282a3fc955e91456aa2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 11:45:04.462425 23424 tablet_bootstrap.cc:492] T 0dda8686bb6646ab937e3ba75b101484 P f860632877484be8b0bb29557b9c45cc: Bootstrap starting.
I20260811 11:45:04.463449 23424 tablet_bootstrap.cc:654] T 0dda8686bb6646ab937e3ba75b101484 P f860632877484be8b0bb29557b9c45cc: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:04.464265 23451 ts_tablet_manager.cc:1918] T d4d84862810b48a087fc079937af0a26 P ea9b9680450b427a9e26507ddc258680: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:45:04.464372 23451 log.cc:1196] T d4d84862810b48a087fc079937af0a26 P ea9b9680450b427a9e26507ddc258680: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-0/wal/wals/d4d84862810b48a087fc079937af0a26
I20260811 11:45:04.464732 23451 ts_tablet_manager.cc:1939] T d4d84862810b48a087fc079937af0a26 P ea9b9680450b427a9e26507ddc258680: Deleting consensus metadata
I20260811 11:45:04.465906 22786 catalog_manager.cc:4841] TS ea9b9680450b427a9e26507ddc258680 (127.20.244.65:39617): tablet d4d84862810b48a087fc079937af0a26 (table test-table [id=721c34ac7a434b509b48738cc227400c]) successfully deleted
I20260811 11:45:04.465975 23424 tablet_bootstrap.cc:492] T 0dda8686bb6646ab937e3ba75b101484 P f860632877484be8b0bb29557b9c45cc: No bootstrap required, opened a new log
I20260811 11:45:04.466046 23424 ts_tablet_manager.cc:1397] T 0dda8686bb6646ab937e3ba75b101484 P f860632877484be8b0bb29557b9c45cc: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 11:45:04.466486 23424 raft_consensus.cc:348] T 0dda8686bb6646ab937e3ba75b101484 P f860632877484be8b0bb29557b9c45cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } }
I20260811 11:45:04.466593 23424 raft_consensus.cc:374] T 0dda8686bb6646ab937e3ba75b101484 P f860632877484be8b0bb29557b9c45cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:04.466624 23424 raft_consensus.cc:729] T 0dda8686bb6646ab937e3ba75b101484 P f860632877484be8b0bb29557b9c45cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f860632877484be8b0bb29557b9c45cc, State: Initialized, Role: FOLLOWER
I20260811 11:45:04.466729 23424 consensus_queue.cc:260] T 0dda8686bb6646ab937e3ba75b101484 P f860632877484be8b0bb29557b9c45cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } }
I20260811 11:45:04.466815 23423 tablet_bootstrap.cc:492] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680: No bootstrap required, opened a new log
I20260811 11:45:04.466917 23423 ts_tablet_manager.cc:1397] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260811 11:45:04.466960 23424 ts_tablet_manager.cc:1428] T 0dda8686bb6646ab937e3ba75b101484 P f860632877484be8b0bb29557b9c45cc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:04.467609 23423 raft_consensus.cc:348] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } }
I20260811 11:45:04.467722 23423 raft_consensus.cc:374] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:04.467758 23423 raft_consensus.cc:729] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea9b9680450b427a9e26507ddc258680, State: Initialized, Role: FOLLOWER
I20260811 11:45:04.467875 23423 consensus_queue.cc:260] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } }
I20260811 11:45:04.468151 23423 ts_tablet_manager.cc:1428] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:04.541028 23429 raft_consensus.cc:482] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:45:04.541172 23429 raft_consensus.cc:504] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } }
I20260811 11:45:04.542485 23429 leader_election.cc:288] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f860632877484be8b0bb29557b9c45cc (127.20.244.66:33043), 299fc50a61734282a3fc955e91456aa2 (127.20.244.67:40007)
I20260811 11:45:04.547001 23421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.543154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:57471 (local address 127.20.244.67:40007)
0811 11:45:04.543290 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:04.543294 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:04.543309 (+ 15us) server_negotiation.cc:407] Connection header received
0811 11:45:04.543369 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:04.543371 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:04.543418 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:04.543501 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:04.543838 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.544648 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.546037 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.546432 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.546562 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.546628 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:04.546812 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 11:45:04.546879 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 11:45:04.547461 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.542745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:40007 (local address 127.20.244.65:57471)
0811 11:45:04.543116 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:04.543129 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:04.543218 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:04.543535 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:04.543538 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:04.543560 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:04.543705 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.543714 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.544761 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.544765 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.545930 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.545940 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.546553 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.546557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.546673 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.546697 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 11:45:04.546794 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 11:45:04.546873 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"spinlock_wait_cycles":30080,"thread_start_us":104,"threads_started":1}
I20260811 11:45:04.547488 23414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.542770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:35787 (local address 127.20.244.66:33043)
0811 11:45:04.542928 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:04.542932 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:04.543120 (+ 188us) server_negotiation.cc:407] Connection header received
0811 11:45:04.543357 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:04.543364 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:04.543418 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:04.543459 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:04.543903 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.544398 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.546013 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.546688 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.546837 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.546892 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:04.547289 (+ 397us) server_negotiation.cc:299] Negotiation successful
0811 11:45:04.547379 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 11:45:04.547528 23459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.542679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:33043 (local address 127.20.244.65:35787)
0811 11:45:04.543014 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:04.543028 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:04.543211 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:04.543615 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:04.543618 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:04.543630 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:04.543745 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.543754 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.544522 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.544525 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.545862 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.545874 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.546963 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.546967 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.547118 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.547142 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 11:45:04.547268 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 11:45:04.547361 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"mutex_wait_us":46,"thread_start_us":104,"threads_started":1}
I20260811 11:45:04.548197 23343 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dda8686bb6646ab937e3ba75b101484" candidate_uuid: "ea9b9680450b427a9e26507ddc258680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "299fc50a61734282a3fc955e91456aa2" is_pre_election: true
I20260811 11:45:04.548374 23343 raft_consensus.cc:2454] T 0dda8686bb6646ab937e3ba75b101484 P 299fc50a61734282a3fc955e91456aa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea9b9680450b427a9e26507ddc258680 in term 0.
I20260811 11:45:04.548425 23163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dda8686bb6646ab937e3ba75b101484" candidate_uuid: "ea9b9680450b427a9e26507ddc258680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860632877484be8b0bb29557b9c45cc" is_pre_election: true
I20260811 11:45:04.548647 23163 raft_consensus.cc:2454] T 0dda8686bb6646ab937e3ba75b101484 P f860632877484be8b0bb29557b9c45cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea9b9680450b427a9e26507ddc258680 in term 0.
I20260811 11:45:04.548765 22911 leader_election.cc:302] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 299fc50a61734282a3fc955e91456aa2, ea9b9680450b427a9e26507ddc258680; no voters:
I20260811 11:45:04.549081 23429 raft_consensus.cc:2781] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:45:04.549149 23429 raft_consensus.cc:482] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:45:04.549204 23429 raft_consensus.cc:3037] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:04.550568 23429 raft_consensus.cc:504] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } }
I20260811 11:45:04.550928 23429 leader_election.cc:288] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680 [CANDIDATE]: Term 1 election: Requested vote from peers f860632877484be8b0bb29557b9c45cc (127.20.244.66:33043), 299fc50a61734282a3fc955e91456aa2 (127.20.244.67:40007)
I20260811 11:45:04.551331 23343 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dda8686bb6646ab937e3ba75b101484" candidate_uuid: "ea9b9680450b427a9e26507ddc258680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "299fc50a61734282a3fc955e91456aa2"
I20260811 11:45:04.551452 23343 raft_consensus.cc:3037] T 0dda8686bb6646ab937e3ba75b101484 P 299fc50a61734282a3fc955e91456aa2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:04.551608 23163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dda8686bb6646ab937e3ba75b101484" candidate_uuid: "ea9b9680450b427a9e26507ddc258680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860632877484be8b0bb29557b9c45cc"
I20260811 11:45:04.551707 23163 raft_consensus.cc:3037] T 0dda8686bb6646ab937e3ba75b101484 P f860632877484be8b0bb29557b9c45cc [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:04.552660 23343 raft_consensus.cc:2454] T 0dda8686bb6646ab937e3ba75b101484 P 299fc50a61734282a3fc955e91456aa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea9b9680450b427a9e26507ddc258680 in term 1.
I20260811 11:45:04.552827 23163 raft_consensus.cc:2454] T 0dda8686bb6646ab937e3ba75b101484 P f860632877484be8b0bb29557b9c45cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea9b9680450b427a9e26507ddc258680 in term 1.
I20260811 11:45:04.552955 22911 leader_election.cc:302] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 299fc50a61734282a3fc955e91456aa2, ea9b9680450b427a9e26507ddc258680; no voters:
I20260811 11:45:04.553140 23429 raft_consensus.cc:2781] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:04.553391 23429 raft_consensus.cc:686] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680 [term 1 LEADER]: Becoming Leader. State: Replica: ea9b9680450b427a9e26507ddc258680, State: Running, Role: LEADER
I20260811 11:45:04.553675 23429 consensus_queue.cc:237] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } }
I20260811 11:45:04.556044 22802 catalog_manager.cc:5495] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea9b9680450b427a9e26507ddc258680 (127.20.244.65). New cstate: current_term: 1 leader_uuid: "ea9b9680450b427a9e26507ddc258680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } health_report { overall_health: UNKNOWN } } }
Aug 11 11:45:04 dist-test-slave-vkjp krb5kdc[22742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448703, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:04.590413 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.580837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49972 (local address 127.20.244.126:44193)
0811 11:45:04.580975 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:04.580979 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:04.581198 (+ 219us) server_negotiation.cc:407] Connection header received
0811 11:45:04.581353 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:04.581355 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:04.581395 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:04.581463 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:04.582353 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.582869 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.584014 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.584221 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.584301 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.586778 (+ 2477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:04.586782 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:04.586784 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:04.586809 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:04.588380 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:04.588958 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:04.588962 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:04.588964 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:04.589053 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:04.589395 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:04.589399 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:04.589400 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:04.589619 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:04.589712 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:04.590053 (+ 341us) server_negotiation.cc:299] Negotiation successful
0811 11:45:04.590204 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 11:45:04.590551 23468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.580759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:44193 (local address 127.0.0.1:49972)
0811 11:45:04.581097 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:04.581115 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:04.581241 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:04.581531 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:04.581534 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:04.582060 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:04.582214 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.582223 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.582983 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.582987 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.583892 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.583902 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.584332 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.584336 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.584420 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.585023 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:04.585037 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:04.586645 (+ 1608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:04.588502 (+ 1857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:04.588513 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:04.588519 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:04.588857 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:04.589140 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:04.589142 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:04.589144 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:04.589281 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:04.589757 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:04.589764 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:04.589874 (+ 110us) client_negotiation.cc:769] Sending connection context
0811 11:45:04.589985 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 11:45:04.590139 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":111,"threads_started":1}
I20260811 11:45:04.594904 22802 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:49972:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 11:45:04.595803 22802 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:45:04.601503 23135 tablet_service.cc:1467] Processing CreateTablet for tablet 9a6e869d230f4432acfeada210c4b4ac (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e21a3144d2344e9296d27336d9fb3886]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 11:45:04.601827 22966 tablet_service.cc:1467] Processing CreateTablet for tablet 9a6e869d230f4432acfeada210c4b4ac (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e21a3144d2344e9296d27336d9fb3886]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 11:45:04.602007 23135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a6e869d230f4432acfeada210c4b4ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:04.602147 22966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a6e869d230f4432acfeada210c4b4ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:04.604984 23424 tablet_bootstrap.cc:492] T 9a6e869d230f4432acfeada210c4b4ac P f860632877484be8b0bb29557b9c45cc: Bootstrap starting.
I20260811 11:45:04.605000 23423 tablet_bootstrap.cc:492] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680: Bootstrap starting.
I20260811 11:45:04.605403 23318 tablet_service.cc:1467] Processing CreateTablet for tablet 9a6e869d230f4432acfeada210c4b4ac (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e21a3144d2344e9296d27336d9fb3886]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 11:45:04.605736 23318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a6e869d230f4432acfeada210c4b4ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:04.605872 23424 tablet_bootstrap.cc:654] T 9a6e869d230f4432acfeada210c4b4ac P f860632877484be8b0bb29557b9c45cc: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:04.605872 23423 tablet_bootstrap.cc:654] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:04.607841 23423 tablet_bootstrap.cc:492] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680: No bootstrap required, opened a new log
I20260811 11:45:04.607941 23423 ts_tablet_manager.cc:1397] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 11:45:04.608351 23423 raft_consensus.cc:348] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } }
I20260811 11:45:04.608449 23423 raft_consensus.cc:374] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:04.608475 23423 raft_consensus.cc:729] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea9b9680450b427a9e26507ddc258680, State: Initialized, Role: FOLLOWER
I20260811 11:45:04.608592 23423 consensus_queue.cc:260] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } }
I20260811 11:45:04.608834 23423 ts_tablet_manager.cc:1428] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 11:45:04.608935 23429 tablet_replica.cc:439] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } } }
I20260811 11:45:04.609078 23429 tablet_replica.cc:442] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:45:04.611184 23422 tablet_bootstrap.cc:492] T 9a6e869d230f4432acfeada210c4b4ac P 299fc50a61734282a3fc955e91456aa2: Bootstrap starting.
I20260811 11:45:04.612061 23422 tablet_bootstrap.cc:654] T 9a6e869d230f4432acfeada210c4b4ac P 299fc50a61734282a3fc955e91456aa2: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:04.613833 23422 tablet_bootstrap.cc:492] T 9a6e869d230f4432acfeada210c4b4ac P 299fc50a61734282a3fc955e91456aa2: No bootstrap required, opened a new log
I20260811 11:45:04.613960 23422 ts_tablet_manager.cc:1397] T 9a6e869d230f4432acfeada210c4b4ac P 299fc50a61734282a3fc955e91456aa2: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 11:45:04.614382 23422 raft_consensus.cc:348] T 9a6e869d230f4432acfeada210c4b4ac P 299fc50a61734282a3fc955e91456aa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } }
I20260811 11:45:04.614473 23422 raft_consensus.cc:374] T 9a6e869d230f4432acfeada210c4b4ac P 299fc50a61734282a3fc955e91456aa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:04.614496 23422 raft_consensus.cc:729] T 9a6e869d230f4432acfeada210c4b4ac P 299fc50a61734282a3fc955e91456aa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 299fc50a61734282a3fc955e91456aa2, State: Initialized, Role: FOLLOWER
I20260811 11:45:04.614637 23422 consensus_queue.cc:260] T 9a6e869d230f4432acfeada210c4b4ac P 299fc50a61734282a3fc955e91456aa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } }
I20260811 11:45:04.614904 23422 ts_tablet_manager.cc:1428] T 9a6e869d230f4432acfeada210c4b4ac P 299fc50a61734282a3fc955e91456aa2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:04.615021 23432 tablet_replica.cc:439] T 9a6e869d230f4432acfeada210c4b4ac P 299fc50a61734282a3fc955e91456aa2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } } }
I20260811 11:45:04.615196 23432 tablet_replica.cc:442] T 9a6e869d230f4432acfeada210c4b4ac P 299fc50a61734282a3fc955e91456aa2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:45:04.615993 23424 tablet_bootstrap.cc:492] T 9a6e869d230f4432acfeada210c4b4ac P f860632877484be8b0bb29557b9c45cc: No bootstrap required, opened a new log
I20260811 11:45:04.616106 23424 ts_tablet_manager.cc:1397] T 9a6e869d230f4432acfeada210c4b4ac P f860632877484be8b0bb29557b9c45cc: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20260811 11:45:04.616562 23424 raft_consensus.cc:348] T 9a6e869d230f4432acfeada210c4b4ac P f860632877484be8b0bb29557b9c45cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } }
I20260811 11:45:04.616681 23424 raft_consensus.cc:374] T 9a6e869d230f4432acfeada210c4b4ac P f860632877484be8b0bb29557b9c45cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:04.616716 23424 raft_consensus.cc:729] T 9a6e869d230f4432acfeada210c4b4ac P f860632877484be8b0bb29557b9c45cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f860632877484be8b0bb29557b9c45cc, State: Initialized, Role: FOLLOWER
I20260811 11:45:04.616847 23424 consensus_queue.cc:260] T 9a6e869d230f4432acfeada210c4b4ac P f860632877484be8b0bb29557b9c45cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } }
I20260811 11:45:04.617108 23424 ts_tablet_manager.cc:1428] T 9a6e869d230f4432acfeada210c4b4ac P f860632877484be8b0bb29557b9c45cc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:04.617314 23435 tablet_replica.cc:439] T 9a6e869d230f4432acfeada210c4b4ac P f860632877484be8b0bb29557b9c45cc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } } }
I20260811 11:45:04.617437 23435 tablet_replica.cc:442] T 9a6e869d230f4432acfeada210c4b4ac P f860632877484be8b0bb29557b9c45cc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:45:04.675143 23429 raft_consensus.cc:482] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:45:04.675272 23429 raft_consensus.cc:504] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } }
I20260811 11:45:04.675675 23429 leader_election.cc:288] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f860632877484be8b0bb29557b9c45cc (127.20.244.66:33043), 299fc50a61734282a3fc955e91456aa2 (127.20.244.67:40007)
I20260811 11:45:04.676057 23163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a6e869d230f4432acfeada210c4b4ac" candidate_uuid: "ea9b9680450b427a9e26507ddc258680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860632877484be8b0bb29557b9c45cc" is_pre_election: true
I20260811 11:45:04.676095 23343 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a6e869d230f4432acfeada210c4b4ac" candidate_uuid: "ea9b9680450b427a9e26507ddc258680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "299fc50a61734282a3fc955e91456aa2" is_pre_election: true
I20260811 11:45:04.676229 23163 raft_consensus.cc:2454] T 9a6e869d230f4432acfeada210c4b4ac P f860632877484be8b0bb29557b9c45cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea9b9680450b427a9e26507ddc258680 in term 0.
I20260811 11:45:04.676244 23343 raft_consensus.cc:2454] T 9a6e869d230f4432acfeada210c4b4ac P 299fc50a61734282a3fc955e91456aa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea9b9680450b427a9e26507ddc258680 in term 0.
I20260811 11:45:04.676538 22909 leader_election.cc:302] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea9b9680450b427a9e26507ddc258680, f860632877484be8b0bb29557b9c45cc; no voters:
I20260811 11:45:04.676733 23429 raft_consensus.cc:2781] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:45:04.676813 23429 raft_consensus.cc:482] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:45:04.676846 23429 raft_consensus.cc:3037] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:04.677826 23429 raft_consensus.cc:504] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } }
I20260811 11:45:04.678189 23429 leader_election.cc:288] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680 [CANDIDATE]: Term 1 election: Requested vote from peers f860632877484be8b0bb29557b9c45cc (127.20.244.66:33043), 299fc50a61734282a3fc955e91456aa2 (127.20.244.67:40007)
I20260811 11:45:04.678547 23163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a6e869d230f4432acfeada210c4b4ac" candidate_uuid: "ea9b9680450b427a9e26507ddc258680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860632877484be8b0bb29557b9c45cc"
I20260811 11:45:04.678584 23343 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a6e869d230f4432acfeada210c4b4ac" candidate_uuid: "ea9b9680450b427a9e26507ddc258680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "299fc50a61734282a3fc955e91456aa2"
I20260811 11:45:04.678645 23163 raft_consensus.cc:3037] T 9a6e869d230f4432acfeada210c4b4ac P f860632877484be8b0bb29557b9c45cc [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:04.678726 23343 raft_consensus.cc:3037] T 9a6e869d230f4432acfeada210c4b4ac P 299fc50a61734282a3fc955e91456aa2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:04.679837 23163 raft_consensus.cc:2454] T 9a6e869d230f4432acfeada210c4b4ac P f860632877484be8b0bb29557b9c45cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea9b9680450b427a9e26507ddc258680 in term 1.
I20260811 11:45:04.679870 23343 raft_consensus.cc:2454] T 9a6e869d230f4432acfeada210c4b4ac P 299fc50a61734282a3fc955e91456aa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea9b9680450b427a9e26507ddc258680 in term 1.
I20260811 11:45:04.680130 22909 leader_election.cc:302] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea9b9680450b427a9e26507ddc258680, f860632877484be8b0bb29557b9c45cc; no voters:
I20260811 11:45:04.680359 23429 raft_consensus.cc:2781] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:04.680455 23429 raft_consensus.cc:686] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680 [term 1 LEADER]: Becoming Leader. State: Replica: ea9b9680450b427a9e26507ddc258680, State: Running, Role: LEADER
I20260811 11:45:04.680586 23429 consensus_queue.cc:237] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } }
I20260811 11:45:04.681283 23461 tablet_replica.cc:439] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680: TxnStatusTablet state changed. Reason: New leader ea9b9680450b427a9e26507ddc258680. Latest consensus state: current_term: 1 leader_uuid: "ea9b9680450b427a9e26507ddc258680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } } }
I20260811 11:45:04.681396 23461 tablet_replica.cc:442] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680: This TxnStatusTablet replica's current role is: LEADER
I20260811 11:45:04.682080 23473 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 11:45:04.682379 23473 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 11:45:04.682546 22802 catalog_manager.cc:5495] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea9b9680450b427a9e26507ddc258680 (127.20.244.65). New cstate: current_term: 1 leader_uuid: "ea9b9680450b427a9e26507ddc258680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } health_report { overall_health: UNKNOWN } } }
I20260811 11:45:04.696993 23420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.693416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36886 (local address 127.20.244.65:39617)
0811 11:45:04.693539 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:04.693544 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:04.693558 (+ 14us) server_negotiation.cc:407] Connection header received
0811 11:45:04.693724 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:04.693727 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:04.693789 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:04.693889 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:45:04.694128 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.694646 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.695590 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.695819 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.695924 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.696218 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:45:04.696608 (+ 390us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:45:04.696731 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:04.696802 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 11:45:04.696859 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 11:45:04.696997 23468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.693292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:39617 (local address 127.0.0.1:36886)
0811 11:45:04.693450 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:04.693468 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:04.693573 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:04.693904 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:04.693907 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:04.693915 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 11:45:04.694022 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.694028 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.694761 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.694764 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.695462 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.695472 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.695936 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.695939 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.696030 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.696073 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 11:45:04.696706 (+ 633us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 11:45:04.696723 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 11:45:04.696793 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 11:45:04.696885 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 11:45:04.699795 23343 raft_consensus.cc:1261] T 9a6e869d230f4432acfeada210c4b4ac P 299fc50a61734282a3fc955e91456aa2 [term 1 FOLLOWER]: Refusing update from remote peer ea9b9680450b427a9e26507ddc258680: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:04.699965 23163 raft_consensus.cc:1261] T 9a6e869d230f4432acfeada210c4b4ac P f860632877484be8b0bb29557b9c45cc [term 1 FOLLOWER]: Refusing update from remote peer ea9b9680450b427a9e26507ddc258680: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:04.700328 23429 consensus_queue.cc:1035] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:04.700529 23461 consensus_queue.cc:1035] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:04.702154 23432 tablet_replica.cc:439] T 9a6e869d230f4432acfeada210c4b4ac P 299fc50a61734282a3fc955e91456aa2: TxnStatusTablet state changed. Reason: New leader ea9b9680450b427a9e26507ddc258680. Latest consensus state: current_term: 1 leader_uuid: "ea9b9680450b427a9e26507ddc258680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } } }
I20260811 11:45:04.702267 23432 tablet_replica.cc:442] T 9a6e869d230f4432acfeada210c4b4ac P 299fc50a61734282a3fc955e91456aa2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:45:04.703017 23435 tablet_replica.cc:439] T 9a6e869d230f4432acfeada210c4b4ac P f860632877484be8b0bb29557b9c45cc: TxnStatusTablet state changed. Reason: New leader ea9b9680450b427a9e26507ddc258680. Latest consensus state: current_term: 1 leader_uuid: "ea9b9680450b427a9e26507ddc258680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } } }
I20260811 11:45:04.703163 23435 tablet_replica.cc:442] T 9a6e869d230f4432acfeada210c4b4ac P f860632877484be8b0bb29557b9c45cc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:45:04.703987 23461 tablet_replica.cc:439] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ea9b9680450b427a9e26507ddc258680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } } }
I20260811 11:45:04.704105 23461 tablet_replica.cc:442] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680: This TxnStatusTablet replica's current role is: LEADER
I20260811 11:45:04.705015 23461 tablet_replica.cc:439] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ea9b9680450b427a9e26507ddc258680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } } }
I20260811 11:45:04.705116 23461 tablet_replica.cc:442] T 9a6e869d230f4432acfeada210c4b4ac P ea9b9680450b427a9e26507ddc258680: This TxnStatusTablet replica's current role is: LEADER
I20260811 11:45:04.705334 23442 mvcc.cc:205] Tried to move back new op lower bound from 7317293894445432832 to 7317293894373101568. Current Snapshot: MvccSnapshot[applied={T|T < 7317293894445432832}]
I20260811 11:45:04.705497 23432 tablet_replica.cc:439] T 9a6e869d230f4432acfeada210c4b4ac P 299fc50a61734282a3fc955e91456aa2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ea9b9680450b427a9e26507ddc258680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } } }
I20260811 11:45:04.705586 23432 tablet_replica.cc:442] T 9a6e869d230f4432acfeada210c4b4ac P 299fc50a61734282a3fc955e91456aa2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:45:04.707412 23435 tablet_replica.cc:439] T 9a6e869d230f4432acfeada210c4b4ac P f860632877484be8b0bb29557b9c45cc: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ea9b9680450b427a9e26507ddc258680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9b9680450b427a9e26507ddc258680" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39617 } } peers { permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 } } peers { permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 } } }
I20260811 11:45:04.707517 23435 tablet_replica.cc:442] T 9a6e869d230f4432acfeada210c4b4ac P f860632877484be8b0bb29557b9c45cc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:45:04.714929 23420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.711585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36898 (local address 127.20.244.65:39617)
0811 11:45:04.711959 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:04.711962 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:04.711972 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:45:04.712005 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:04.712007 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:04.712065 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:04.712148 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:45:04.712405 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.712959 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.713815 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.714047 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.714162 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.714463 (+ 301us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:45:04.714539 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:45:04.714618 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:04.714742 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 11:45:04.714789 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310}
I20260811 11:45:04.725225 23420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.721461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:35797 (local address 127.20.244.65:39617)
0811 11:45:04.721565 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:04.721570 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:04.721751 (+ 181us) server_negotiation.cc:407] Connection header received
0811 11:45:04.721905 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:04.721908 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:04.721956 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:04.722033 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:45:04.722329 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.722810 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.723934 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.724209 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.724333 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.724700 (+ 367us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:45:04.724815 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:45:04.724906 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:04.725000 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 11:45:04.725067 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":9,"server-negotiator.queue_time_us":42}
I20260811 11:45:04.725556 23480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.721353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:39617 (local address 127.20.244.65:35797)
0811 11:45:04.721663 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:04.721679 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:04.721781 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:04.722062 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:04.722065 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:04.722072 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 11:45:04.722203 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.722209 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.722962 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.722969 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.723804 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:04.723815 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.724344 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.724348 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:04.724497 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.724555 (+ 58us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 11:45:04.724911 (+ 356us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 11:45:04.724919 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 11:45:04.724993 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 11:45:04.725098 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"mutex_wait_us":42,"thread_start_us":115,"threads_started":1}
I20260811 11:45:04.732955 23343 raft_consensus.cc:1261] T 0dda8686bb6646ab937e3ba75b101484 P 299fc50a61734282a3fc955e91456aa2 [term 1 FOLLOWER]: Refusing update from remote peer ea9b9680450b427a9e26507ddc258680: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:04.733043 23163 raft_consensus.cc:1261] T 0dda8686bb6646ab937e3ba75b101484 P f860632877484be8b0bb29557b9c45cc [term 1 FOLLOWER]: Refusing update from remote peer ea9b9680450b427a9e26507ddc258680: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:04.733461 23429 consensus_queue.cc:1035] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860632877484be8b0bb29557b9c45cc" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 33043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:04.733644 23461 consensus_queue.cc:1035] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "299fc50a61734282a3fc955e91456aa2" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:04.773860 22802 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49964:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:04.774001 22802 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49964:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:04.775975 22802 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ec565fa2d6f143679e4c52c8c8c78a49: Sending DeleteTablet for 3 replicas of tablet 0dda8686bb6646ab937e3ba75b101484
I20260811 11:45:04.776556 23318 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dda8686bb6646ab937e3ba75b101484 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:04 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:36406
I20260811 11:45:04.776778 23453 tablet_replica.cc:330] T 0dda8686bb6646ab937e3ba75b101484 P 299fc50a61734282a3fc955e91456aa2: stopping tablet replica
I20260811 11:45:04.776746 23135 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dda8686bb6646ab937e3ba75b101484 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:04 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:50170
I20260811 11:45:04.776891 23453 raft_consensus.cc:2229] T 0dda8686bb6646ab937e3ba75b101484 P 299fc50a61734282a3fc955e91456aa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:04.776912 23450 tablet_replica.cc:330] T 0dda8686bb6646ab937e3ba75b101484 P f860632877484be8b0bb29557b9c45cc: stopping tablet replica
I20260811 11:45:04.776997 23453 raft_consensus.cc:2258] T 0dda8686bb6646ab937e3ba75b101484 P 299fc50a61734282a3fc955e91456aa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:04.777004 23450 raft_consensus.cc:2229] T 0dda8686bb6646ab937e3ba75b101484 P f860632877484be8b0bb29557b9c45cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:04.777096 23450 raft_consensus.cc:2258] T 0dda8686bb6646ab937e3ba75b101484 P f860632877484be8b0bb29557b9c45cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:04.777783 23453 ts_tablet_manager.cc:1905] T 0dda8686bb6646ab937e3ba75b101484 P 299fc50a61734282a3fc955e91456aa2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:04.777783 23450 ts_tablet_manager.cc:1905] T 0dda8686bb6646ab937e3ba75b101484 P f860632877484be8b0bb29557b9c45cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:04.777863 22963 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dda8686bb6646ab937e3ba75b101484 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:04 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:36884
I20260811 11:45:04.778041 23451 tablet_replica.cc:330] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680: stopping tablet replica
I20260811 11:45:04.778131 23451 raft_consensus.cc:2229] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:45:04.778416 23451 raft_consensus.cc:2258] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:04.779332 23451 ts_tablet_manager.cc:1905] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:04.780721 23453 ts_tablet_manager.cc:1918] T 0dda8686bb6646ab937e3ba75b101484 P 299fc50a61734282a3fc955e91456aa2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:45:04.780721 23450 ts_tablet_manager.cc:1918] T 0dda8686bb6646ab937e3ba75b101484 P f860632877484be8b0bb29557b9c45cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:45:04.780800 23453 log.cc:1196] T 0dda8686bb6646ab937e3ba75b101484 P 299fc50a61734282a3fc955e91456aa2: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/0dda8686bb6646ab937e3ba75b101484
I20260811 11:45:04.780800 23450 log.cc:1196] T 0dda8686bb6646ab937e3ba75b101484 P f860632877484be8b0bb29557b9c45cc: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/0dda8686bb6646ab937e3ba75b101484
I20260811 11:45:04.781095 23450 ts_tablet_manager.cc:1939] T 0dda8686bb6646ab937e3ba75b101484 P f860632877484be8b0bb29557b9c45cc: Deleting consensus metadata
I20260811 11:45:04.781095 23453 ts_tablet_manager.cc:1939] T 0dda8686bb6646ab937e3ba75b101484 P 299fc50a61734282a3fc955e91456aa2: Deleting consensus metadata
I20260811 11:45:04.781828 22786 catalog_manager.cc:4841] TS 299fc50a61734282a3fc955e91456aa2 (127.20.244.67:40007): tablet 0dda8686bb6646ab937e3ba75b101484 (table test-table [id=693187fc2b724ae288484105b5e79e4d]) successfully deleted
I20260811 11:45:04.782634 23451 ts_tablet_manager.cc:1918] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:45:04.782788 22784 catalog_manager.cc:4841] TS f860632877484be8b0bb29557b9c45cc (127.20.244.66:33043): tablet 0dda8686bb6646ab937e3ba75b101484 (table test-table [id=693187fc2b724ae288484105b5e79e4d]) successfully deleted
I20260811 11:45:04.782708 23451 log.cc:1196] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786448696706302-21457-0/minicluster-data/ts-0/wal/wals/0dda8686bb6646ab937e3ba75b101484
I20260811 11:45:04.783300 23451 ts_tablet_manager.cc:1939] T 0dda8686bb6646ab937e3ba75b101484 P ea9b9680450b427a9e26507ddc258680: Deleting consensus metadata
I20260811 11:45:04.783951 22786 catalog_manager.cc:4841] TS ea9b9680450b427a9e26507ddc258680 (127.20.244.65:39617): tablet 0dda8686bb6646ab937e3ba75b101484 (table test-table [id=693187fc2b724ae288484105b5e79e4d]) successfully deleted
Aug 11 11:45:04 dist-test-slave-vkjp krb5kdc[22742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448704, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.244.65@KRBTEST.COM
I20260811 11:45:04.792277 23420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.781729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36906 (local address 127.20.244.65:39617)
0811 11:45:04.781879 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:04.781883 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:04.782548 (+ 665us) server_negotiation.cc:407] Connection header received
0811 11:45:04.782664 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:04.782670 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:04.782722 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:04.782793 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:04.783713 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.784372 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.785197 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.785418 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.785525 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.788712 (+ 3187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:04.788721 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:04.788733 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:04.788755 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:04.790509 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:04.790943 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:04.790948 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:04.790950 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:04.791027 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:04.791323 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:04.791328 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:04.791333 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:04.791571 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:04.791795 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:04.791971 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 11:45:04.792092 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260811 11:45:04.792778 23038 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36906
I20260811 11:45:04.802351 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:04.794537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49982 (local address 127.20.244.126:44193)
0811 11:45:04.794678 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:04.794683 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:04.794741 (+ 58us) server_negotiation.cc:407] Connection header received
0811 11:45:04.794826 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:04.794829 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:04.794881 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:04.794972 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:04.795629 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.796405 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.797231 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:04.797580 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:04.797695 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:04.798928 (+ 1233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:04.798932 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:04.798935 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:04.798962 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:04.800665 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:04.801096 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:04.801100 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:04.801102 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:04.801201 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:04.801479 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:04.801483 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:04.801485 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:04.801704 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:04.801843 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:04.802052 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 11:45:04.802175 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260811 11:45:04.802768 22802 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49982
I20260811 11:45:04.804927 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 22889
I20260811 11:45:04.815546 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 23055
I20260811 11:45:04.826323 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 23231
I20260811 11:45:04.834152 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 22761
2026-08-11T11:45:04Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3001 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:45:04 dist-test-slave-vkjp krb5kdc[23494](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:45:04 dist-test-slave-vkjp krb5kdc[23494](info): set up 2 sockets
Aug 11 11:45:04 dist-test-slave-vkjp krb5kdc[23494](info): commencing operation
krb5kdc: starting...
W20260811 11:45:05.965471 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:45:06 dist-test-slave-vkjp krb5kdc[23494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:45:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:45:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:45:06.094311 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:35389
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:34005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:35389
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:06.208120 23509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:06.208411 23509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:06.208452 23509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:06.212602 23509 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:06.212666 23509 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 11:45:06.212684 23509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:06.212702 23509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:06.212718 23509 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:06.212775 23509 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:45:06.218191 23509 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:34005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:35389
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:35389
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:06.219388 23509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:06.220563 23509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:06.229890 23515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:06.229928 23516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:06.229913 23518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:06.230283 23509 server_base.cc:1034] running on GCE node
I20260811 11:45:06.230906 23509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:06.232088 23509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:06.233251 23509 hybrid_clock.cc:648] HybridClock initialized: now 1786448706233218 us; error 48 us; skew 500 ppm
Aug 11 11:45:06 dist-test-slave-vkjp krb5kdc[23494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448706, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:06.236146 23509 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:45:06.237111 23509 webserver.cc:460] Webserver started at http://127.20.244.126:41065/ using document root <none> and password file <none>
I20260811 11:45:06.237685 23509 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:06.237747 23509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:06.237996 23509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:06.240145 23509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "50fc8094ae02492fad220ee4cc93a824"
format_stamp: "Formatted at 2026-08-11 11:45:06 on dist-test-slave-vkjp"
server_key: "b6ef5729ffe3c91d9298dc95dd2ce2d8"
server_key_iv: "1ce8ae7f42886f2eec9699d7e7ca8d22"
server_key_version: "encryptionkey@0"
I20260811 11:45:06.240792 23509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "50fc8094ae02492fad220ee4cc93a824"
format_stamp: "Formatted at 2026-08-11 11:45:06 on dist-test-slave-vkjp"
server_key: "b6ef5729ffe3c91d9298dc95dd2ce2d8"
server_key_iv: "1ce8ae7f42886f2eec9699d7e7ca8d22"
server_key_version: "encryptionkey@0"
I20260811 11:45:06.244669 23509 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 11:45:06.247220 23527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:06.248450 23509 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:45:06.248605 23509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "50fc8094ae02492fad220ee4cc93a824"
format_stamp: "Formatted at 2026-08-11 11:45:06 on dist-test-slave-vkjp"
server_key: "b6ef5729ffe3c91d9298dc95dd2ce2d8"
server_key_iv: "1ce8ae7f42886f2eec9699d7e7ca8d22"
server_key_version: "encryptionkey@0"
I20260811 11:45:06.248723 23509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:06.265523 23509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:06.268641 23509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:06.268848 23509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:06.277243 23509 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:35389
I20260811 11:45:06.277259 23604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:35389 every 8 connection(s)
I20260811 11:45:06.278213 23509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:45:06.280953 23605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:06.281507 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 23509
I20260811 11:45:06.281627 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:45:06.281909 21457 external_mini_cluster.cc:1428] Setting key 9cc57d03d5c9e337b8b2f6bff706c8f2
I20260811 11:45:06.287202 23605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824: Bootstrap starting.
I20260811 11:45:06.289832 23605 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:06.290642 23605 log.cc:824] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824: Log is configured to *not* fsync() on all Append() calls
Aug 11 11:45:06 dist-test-slave-vkjp krb5kdc[23494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:06.292469 23605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824: No bootstrap required, opened a new log
I20260811 11:45:06.295326 23605 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50fc8094ae02492fad220ee4cc93a824" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 35389 } }
I20260811 11:45:06.295560 23605 raft_consensus.cc:374] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:06.295614 23605 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50fc8094ae02492fad220ee4cc93a824, State: Initialized, Role: FOLLOWER
I20260811 11:45:06.296063 23605 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50fc8094ae02492fad220ee4cc93a824" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 35389 } }
I20260811 11:45:06.296217 23605 raft_consensus.cc:388] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:45:06.296317 23605 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:45:06.296442 23605 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:06.296852 23608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:06.283334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32918 (local address 127.20.244.126:35389)
0811 11:45:06.283697 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:06.283715 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:06.283760 (+ 45us) server_negotiation.cc:407] Connection header received
0811 11:45:06.284394 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:06.284411 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:06.284732 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:06.284999 (+ 267us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:06.285892 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:06.286858 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:06.288004 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:06.288451 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:06.288577 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:06.291332 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:06.291337 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:06.291349 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:06.291376 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:06.293751 (+ 2375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:06.294219 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:06.294224 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:06.294228 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:06.294337 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:06.294652 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:06.294655 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:06.294656 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:06.295038 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:06.295320 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:06.295617 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 11:45:06.295931 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":115,"threads_started":1}
I20260811 11:45:06.297391 23605 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50fc8094ae02492fad220ee4cc93a824" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 35389 } }
I20260811 11:45:06.297712 23605 leader_election.cc:302] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 50fc8094ae02492fad220ee4cc93a824; no voters:
I20260811 11:45:06.298058 23605 leader_election.cc:288] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:45:06.298135 23610 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:06.298326 23610 raft_consensus.cc:686] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824 [term 1 LEADER]: Becoming Leader. State: Replica: 50fc8094ae02492fad220ee4cc93a824, State: Running, Role: LEADER
I20260811 11:45:06.298609 23610 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50fc8094ae02492fad220ee4cc93a824" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 35389 } }
I20260811 11:45:06.299327 23605 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:45:06.299763 23610 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50fc8094ae02492fad220ee4cc93a824. Latest consensus state: current_term: 1 leader_uuid: "50fc8094ae02492fad220ee4cc93a824" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50fc8094ae02492fad220ee4cc93a824" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 35389 } } }
I20260811 11:45:06.299877 23610 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:06.300421 23611 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "50fc8094ae02492fad220ee4cc93a824" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50fc8094ae02492fad220ee4cc93a824" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 35389 } } }
I20260811 11:45:06.300590 23611 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:06.301623 23615 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:45:06.304302 23615 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:45:06.309273 23615 catalog_manager.cc:1347] Generated new cluster ID: f2c591d289124cc383865cc5b5a0651f
I20260811 11:45:06.309340 23615 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:45:06.324916 23615 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:45:06.325909 23615 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:45:06.335973 23615 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824: Generated new TSK 0
I20260811 11:45:06.336694 23615 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.244.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
I20260811 11:45:06.374306 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:35389
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:34005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:06.495301 23638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:06.495558 23638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:06.495642 23638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:06.499722 23638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:06.499778 23638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:06.499845 23638 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 11:45:06.499881 23638 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 11:45:06.499948 23638 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:45:06.505213 23638 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:34005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.244.126:35389
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:06.506217 23638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:06.507267 23638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:06.516703 23647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:06.516808 23638 server_base.cc:1034] running on GCE node
W20260811 11:45:06.516698 23646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:06.516702 23650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:06.517436 23638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:06.518107 23638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:06.519294 23638 hybrid_clock.cc:648] HybridClock initialized: now 1786448706519268 us; error 46 us; skew 500 ppm
Aug 11 11:45:06 dist-test-slave-vkjp krb5kdc[23494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448706, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:06.522202 23638 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:45:06.523059 23638 webserver.cc:460] Webserver started at http://127.20.244.65:33473/ using document root <none> and password file <none>
I20260811 11:45:06.523686 23638 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:06.523783 23638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:06.524027 23638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:06.526038 23638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "a0c03d7e437c48449e95d4ebe7e2dea6"
format_stamp: "Formatted at 2026-08-11 11:45:06 on dist-test-slave-vkjp"
server_key: "d6bf6a96a847dfc155efc050fcdd2e53"
server_key_iv: "68d74882e94899b608cc8f483cd5682b"
server_key_version: "encryptionkey@0"
I20260811 11:45:06.526677 23638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "a0c03d7e437c48449e95d4ebe7e2dea6"
format_stamp: "Formatted at 2026-08-11 11:45:06 on dist-test-slave-vkjp"
server_key: "d6bf6a96a847dfc155efc050fcdd2e53"
server_key_iv: "68d74882e94899b608cc8f483cd5682b"
server_key_version: "encryptionkey@0"
I20260811 11:45:06.530365 23638 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260811 11:45:06.532792 23657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:06.533932 23638 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260811 11:45:06.534068 23638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "a0c03d7e437c48449e95d4ebe7e2dea6"
format_stamp: "Formatted at 2026-08-11 11:45:06 on dist-test-slave-vkjp"
server_key: "d6bf6a96a847dfc155efc050fcdd2e53"
server_key_iv: "68d74882e94899b608cc8f483cd5682b"
server_key_version: "encryptionkey@0"
I20260811 11:45:06.534181 23638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:06.544340 23638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:06.547451 23638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:06.547644 23638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:06.549013 23638 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:06.549086 23638 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:06.549157 23638 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:06.549211 23638 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 11:45:06 dist-test-slave-vkjp krb5kdc[23494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448706, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:06.559993 23638 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:40627
I20260811 11:45:06.560034 23801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:40627 every 8 connection(s)
I20260811 11:45:06.561045 23638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:45:06.561611 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 23638
I20260811 11:45:06.561731 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:45:06.562063 21457 external_mini_cluster.cc:1428] Setting key fc9540bc826df5eb7fc5ea7ad6f70479
I20260811 11:45:06.564383 23608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:06.549917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:33059 (local address 127.20.244.126:35389)
0811 11:45:06.550040 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:06.550044 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:06.551052 (+ 1008us) server_negotiation.cc:407] Connection header received
0811 11:45:06.552278 (+ 1226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:06.552282 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:06.552343 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:06.552441 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:06.554089 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:06.555026 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:06.556921 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:06.557150 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:06.557230 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:06.560399 (+ 3169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:06.560403 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:06.560406 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:06.560435 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:06.562099 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:06.562676 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:06.562682 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:06.562684 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:06.562802 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:06.563243 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:06.563246 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:06.563248 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:06.563493 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:06.563600 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:06.564160 (+ 560us) server_negotiation.cc:299] Negotiation successful
0811 11:45:06.564265 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 11:45:06.565538 23666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:06.550432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:35389 (local address 127.20.244.65:33059)
0811 11:45:06.550910 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:06.550950 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:06.552018 (+ 1068us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:06.552672 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:06.552684 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:06.553209 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:06.553931 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:06.553954 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:06.555188 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:06.555194 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:06.556780 (+ 1586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:06.556790 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:06.557319 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:06.557324 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:06.557565 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:06.558308 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:06.558335 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:06.560219 (+ 1884us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:06.562216 (+ 1997us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:06.562221 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:06.562235 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:06.562571 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:06.562889 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:06.562892 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:06.562894 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:06.563045 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:06.563611 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:06.563618 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:06.563899 (+ 281us) client_negotiation.cc:769] Sending connection context
0811 11:45:06.564105 (+ 206us) client_negotiation.cc:240] Negotiation successful
0811 11:45:06.564488 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":144,"threads_started":1}
I20260811 11:45:06.566946 23802 heartbeater.cc:347] Connected to a master server at 127.20.244.126:35389
I20260811 11:45:06.567301 23802 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:06.567844 23802 heartbeater.cc:511] Master 127.20.244.126:35389 requested a full tablet report, sending...
I20260811 11:45:06.569500 23546 ts_manager.cc:194] Registered new tserver with Master: a0c03d7e437c48449e95d4ebe7e2dea6 (127.20.244.65:40627)
I20260811 11:45:06.570627 23546 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:33059
WARNING: no policy specified for kudu/127.20.244.66@KRBTEST.COM; defaulting to no policy
I20260811 11:45:06.578549 23812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:06.569418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:35389 (local address 127.20.244.65:52331)
0811 11:45:06.571894 (+ 2476us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:06.571907 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:06.571987 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:06.572204 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:06.572206 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:06.572369 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:06.572463 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:06.572468 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:06.573294 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:06.573297 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:06.573833 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:06.573841 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:06.574334 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:06.574337 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:06.574444 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:06.574979 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:06.574991 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:06.575372 (+ 381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:06.577044 (+ 1672us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:06.577047 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:06.577050 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:06.577245 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:06.577542 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:06.577545 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:06.577547 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:06.577631 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:06.578001 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:06.578004 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:06.578103 (+ 99us) client_negotiation.cc:769] Sending connection context
0811 11:45:06.578214 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 11:45:06.578348 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2394,"thread_start_us":90,"threads_started":1}
I20260811 11:45:06.578611 23608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:06.569506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:52331 (local address 127.20.244.126:35389)
0811 11:45:06.569624 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:06.569630 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:06.571989 (+ 2359us) server_negotiation.cc:407] Connection header received
0811 11:45:06.572043 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:06.572046 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:06.572091 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:06.572181 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:06.572575 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:06.573152 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:06.573990 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:06.574212 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:06.574318 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:06.575507 (+ 1189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:06.575513 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:06.575521 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:06.575542 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:06.576861 (+ 1319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:06.577355 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:06.577359 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:06.577360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:06.577447 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:06.577724 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:06.577728 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:06.577730 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:06.577901 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:06.578010 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:06.578311 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 11:45:06.578471 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
I20260811 11:45:06.594396 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:35389
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:34005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:06.712160 23815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:06.712430 23815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:06.712478 23815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:06.716387 23815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:06.716439 23815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:06.716481 23815 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 11:45:06.716498 23815 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 11:45:06.716532 23815 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:45:06.721611 23815 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:34005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.244.126:35389
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:06.722553 23815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:06.723526 23815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:06.733187 23823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:06.733217 23820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:06.733217 23821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:06.733578 23815 server_base.cc:1034] running on GCE node
I20260811 11:45:06.733975 23815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:06.734637 23815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:06.735823 23815 hybrid_clock.cc:648] HybridClock initialized: now 1786448706735809 us; error 33 us; skew 500 ppm
Aug 11 11:45:06 dist-test-slave-vkjp krb5kdc[23494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448706, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:06.738617 23815 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:45:06.739696 23815 webserver.cc:460] Webserver started at http://127.20.244.66:39385/ using document root <none> and password file <none>
I20260811 11:45:06.740324 23815 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:06.740428 23815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:06.740722 23815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:06.742945 23815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "af8d204d347244ba948cb9a487f46a64"
format_stamp: "Formatted at 2026-08-11 11:45:06 on dist-test-slave-vkjp"
server_key: "0093fbadb6f1eeb530d9cf1ddc543a55"
server_key_iv: "d361e7a6a9c6c4245e4f306be62538bc"
server_key_version: "encryptionkey@0"
I20260811 11:45:06.743646 23815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "af8d204d347244ba948cb9a487f46a64"
format_stamp: "Formatted at 2026-08-11 11:45:06 on dist-test-slave-vkjp"
server_key: "0093fbadb6f1eeb530d9cf1ddc543a55"
server_key_iv: "d361e7a6a9c6c4245e4f306be62538bc"
server_key_version: "encryptionkey@0"
I20260811 11:45:06.747778 23815 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 11:45:06.750346 23832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:06.751783 23815 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:45:06.751938 23815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "af8d204d347244ba948cb9a487f46a64"
format_stamp: "Formatted at 2026-08-11 11:45:06 on dist-test-slave-vkjp"
server_key: "0093fbadb6f1eeb530d9cf1ddc543a55"
server_key_iv: "d361e7a6a9c6c4245e4f306be62538bc"
server_key_version: "encryptionkey@0"
I20260811 11:45:06.752064 23815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:06.769541 23815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:06.772722 23815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:06.772961 23815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:06.774600 23815 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:06.774691 23815 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:06.774766 23815 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:06.774839 23815 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 11:45:06 dist-test-slave-vkjp krb5kdc[23494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448706, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:06.786664 23815 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:44519
I20260811 11:45:06.786724 23977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:44519 every 8 connection(s)
I20260811 11:45:06.787710 23815 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:45:06.789800 23608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:06.775376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:50197 (local address 127.20.244.126:35389)
0811 11:45:06.775554 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:06.775559 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:06.776996 (+ 1437us) server_negotiation.cc:407] Connection header received
0811 11:45:06.778537 (+ 1541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:06.778540 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:06.778599 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:06.778684 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:06.780543 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:06.781267 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:06.782524 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:06.782750 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:06.782866 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:06.786031 (+ 3165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:06.786035 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:06.786038 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:06.786064 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:06.787615 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:06.788179 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:06.788183 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:06.788185 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:06.788268 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:06.788667 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:06.788671 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:06.788672 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:06.788944 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:06.789040 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:06.789569 (+ 529us) server_negotiation.cc:299] Negotiation successful
0811 11:45:06.789679 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 11:45:06.790573 23843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:06.776296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:35389 (local address 127.20.244.66:50197)
0811 11:45:06.776807 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:06.776878 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:06.778249 (+ 1371us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:06.778921 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:06.778936 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:06.779551 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:06.780358 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:06.780386 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:06.781401 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:06.781404 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:06.782410 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:06.782419 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:06.782914 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:06.782918 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:06.783139 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:06.784297 (+ 1158us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:06.784316 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:06.785866 (+ 1550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:06.787736 (+ 1870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:06.787742 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:06.787756 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:06.788071 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:06.788365 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:06.788369 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:06.788371 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:06.788550 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:06.789072 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:06.789078 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:06.789314 (+ 236us) client_negotiation.cc:769] Sending connection context
0811 11:45:06.789477 (+ 163us) client_negotiation.cc:240] Negotiation successful
0811 11:45:06.789712 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":101,"threads_started":1}
I20260811 11:45:06.791419 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 23815
I20260811 11:45:06.791558 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:45:06.791859 21457 external_mini_cluster.cc:1428] Setting key 2ab9d1879cdbc49f1af3e537f67e107f
I20260811 11:45:06.791942 23978 heartbeater.cc:347] Connected to a master server at 127.20.244.126:35389
I20260811 11:45:06.792089 23978 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:06.792681 23978 heartbeater.cc:511] Master 127.20.244.126:35389 requested a full tablet report, sending...
I20260811 11:45:06.793745 23546 ts_manager.cc:194] Registered new tserver with Master: af8d204d347244ba948cb9a487f46a64 (127.20.244.66:44519)
I20260811 11:45:06.794564 23546 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:50197
I20260811 11:45:06.802788 23608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:06.794317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:49921 (local address 127.20.244.126:35389)
0811 11:45:06.794445 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:06.794450 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:06.794687 (+ 237us) server_negotiation.cc:407] Connection header received
0811 11:45:06.794932 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:06.794935 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:06.794983 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:06.795056 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:06.795685 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:06.796416 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:06.797357 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:06.797753 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:06.797889 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:06.798913 (+ 1024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:06.798916 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:06.798919 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:06.798955 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:06.800752 (+ 1797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:06.801267 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:06.801271 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:06.801273 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:06.801392 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:06.801691 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:06.801696 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:06.801697 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:06.801998 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:06.802229 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:06.802512 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 11:45:06.802630 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 11:45:06.802803 23984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:06.794267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:35389 (local address 127.20.244.66:49921)
0811 11:45:06.794601 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:06.794613 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:06.794725 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:06.795193 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:06.795195 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:06.795378 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:06.795568 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:06.795578 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:06.796591 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:06.796594 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:06.797241 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:06.797250 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:06.797874 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:06.797877 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:06.797945 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:06.798459 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:06.798469 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:06.798770 (+ 301us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:06.800888 (+ 2118us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:06.800891 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:06.800893 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:06.801181 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:06.801499 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:06.801503 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:06.801505 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:06.801597 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:06.802213 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:06.802217 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:06.802328 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 11:45:06.802451 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 11:45:06.802614 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"mutex_wait_us":4,"thread_start_us":118,"threads_started":1}
WARNING: no policy specified for kudu/127.20.244.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
I20260811 11:45:06.822592 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:35389
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:34005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:06.936662 23987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:06.936951 23987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:06.937028 23987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:06.941215 23987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:06.941299 23987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:06.941354 23987 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 11:45:06.941380 23987 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 11:45:06.941454 23987 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:45:06.946583 23987 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:34005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.244.126:35389
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:06.947685 23987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:06.948774 23987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:45:06.959007 23987 server_base.cc:1034] running on GCE node
W20260811 11:45:06.958967 23997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:06.958967 23994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:06.959034 23993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:06.959652 23987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:06.960289 23987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:06.961463 23987 hybrid_clock.cc:648] HybridClock initialized: now 1786448706961445 us; error 27 us; skew 500 ppm
Aug 11 11:45:06 dist-test-slave-vkjp krb5kdc[23494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448706, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:06.964382 23987 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:45:06.965272 23987 webserver.cc:460] Webserver started at http://127.20.244.67:37351/ using document root <none> and password file <none>
I20260811 11:45:06.965837 23987 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:06.965901 23987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:06.966081 23987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:06.968356 23987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "3c3f4922132c4f2fa77d66470f48063b"
format_stamp: "Formatted at 2026-08-11 11:45:06 on dist-test-slave-vkjp"
server_key: "d42ef9b197d4fe0f7c0c8369096be162"
server_key_iv: "d74e9d178e76830ab39915b57efd7f45"
server_key_version: "encryptionkey@0"
I20260811 11:45:06.968940 23987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "3c3f4922132c4f2fa77d66470f48063b"
format_stamp: "Formatted at 2026-08-11 11:45:06 on dist-test-slave-vkjp"
server_key: "d42ef9b197d4fe0f7c0c8369096be162"
server_key_iv: "d74e9d178e76830ab39915b57efd7f45"
server_key_version: "encryptionkey@0"
I20260811 11:45:06.973119 23987 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 11:45:06.975696 24005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:06.977008 23987 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:45:06.977111 23987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "3c3f4922132c4f2fa77d66470f48063b"
format_stamp: "Formatted at 2026-08-11 11:45:06 on dist-test-slave-vkjp"
server_key: "d42ef9b197d4fe0f7c0c8369096be162"
server_key_iv: "d74e9d178e76830ab39915b57efd7f45"
server_key_version: "encryptionkey@0"
I20260811 11:45:06.977203 23987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:07.006043 23987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:07.009532 23987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:07.009763 23987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:07.011308 23987 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:07.011365 23987 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:07.011407 23987 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:07.011461 23987 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 11:45:07 dist-test-slave-vkjp krb5kdc[23494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448706, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:07.023046 23987 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:40507
I20260811 11:45:07.023180 24153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:40507 every 8 connection(s)
I20260811 11:45:07.024174 23987 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:45:07.025897 23608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.012233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:57115 (local address 127.20.244.126:35389)
0811 11:45:07.012397 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:07.012403 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:07.013327 (+ 924us) server_negotiation.cc:407] Connection header received
0811 11:45:07.014503 (+ 1176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:07.014506 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:07.014574 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:07.014665 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:07.016193 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.016783 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.018205 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.018472 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.018594 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.021896 (+ 3302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:07.021898 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:07.021901 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:07.021929 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:07.023663 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:07.024277 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:07.024283 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:07.024286 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:07.024378 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:07.024800 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:07.024806 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:07.024809 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:07.025076 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:07.025183 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:07.025644 (+ 461us) server_negotiation.cc:299] Negotiation successful
0811 11:45:07.025752 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 11:45:07.026950 24020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.012665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:35389 (local address 127.20.244.67:57115)
0811 11:45:07.013142 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:07.013195 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:07.014246 (+ 1051us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:07.015019 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:07.015027 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:07.015444 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:07.016034 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.016048 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.016914 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.016920 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.018059 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.018070 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.018659 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.018664 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.018897 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.019692 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:07.019710 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:07.021707 (+ 1997us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:07.023782 (+ 2075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:07.023791 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:07.023807 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:07.024150 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:07.024480 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:07.024484 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:07.024488 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:07.024679 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:07.025186 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:07.025191 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:07.025412 (+ 221us) client_negotiation.cc:769] Sending connection context
0811 11:45:07.025584 (+ 172us) client_negotiation.cc:240] Negotiation successful
0811 11:45:07.025829 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":136,"threads_started":1}
I20260811 11:45:07.028378 24154 heartbeater.cc:347] Connected to a master server at 127.20.244.126:35389
I20260811 11:45:07.028546 24154 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:07.029044 24154 heartbeater.cc:511] Master 127.20.244.126:35389 requested a full tablet report, sending...
I20260811 11:45:07.030123 23545 ts_manager.cc:194] Registered new tserver with Master: 3c3f4922132c4f2fa77d66470f48063b (127.20.244.67:40507)
I20260811 11:45:07.030261 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 23987
I20260811 11:45:07.030377 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:45:07.030675 21457 external_mini_cluster.cc:1428] Setting key fe04d39bbdfed4255626a9432341cb48
I20260811 11:45:07.030963 23545 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:57115
I20260811 11:45:07.032799 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:45:07.038483 23608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.031025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:56319 (local address 127.20.244.126:35389)
0811 11:45:07.031157 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:07.031161 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:07.031174 (+ 13us) server_negotiation.cc:407] Connection header received
0811 11:45:07.031208 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:07.031211 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:07.031251 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:07.031335 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:07.031938 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.032461 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.033560 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.033931 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.034062 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.035200 (+ 1138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:07.035207 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:07.035213 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:07.035246 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:07.036733 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:07.037180 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:07.037184 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:07.037186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:07.037269 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:07.037557 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:07.037561 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:07.037563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:07.037738 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:07.037943 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:07.038264 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 11:45:07.038357 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 11:45:07.038617 24162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.030559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:35389 (local address 127.20.244.67:56319)
0811 11:45:07.030887 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:07.030900 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:07.031007 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:07.031442 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:07.031445 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:07.031659 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:07.031770 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.031777 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.032601 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.032604 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.033430 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.033439 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.034051 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.034054 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.034122 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.034670 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:07.034682 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:07.035029 (+ 347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:07.036852 (+ 1823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:07.036858 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:07.036860 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:07.037074 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:07.037365 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:07.037368 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:07.037370 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:07.037462 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:07.037947 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:07.037952 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:07.038080 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 11:45:07.038222 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 11:45:07.038394 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"mutex_wait_us":4,"thread_start_us":110,"threads_started":1}
Aug 11 11:45:07 dist-test-slave-vkjp krb5kdc[23494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 11:45:07 dist-test-slave-vkjp krb5kdc[23494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:07.060634 23608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.052268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32922 (local address 127.20.244.126:35389)
0811 11:45:07.052441 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:07.052445 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:07.052456 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:45:07.052497 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:07.052499 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:07.052539 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:07.052629 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:07.053367 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.053897 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.054753 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.054984 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.055118 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.057618 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:07.057621 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:07.057624 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:07.057650 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:07.059237 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:07.059619 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:07.059621 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:07.059622 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:07.059696 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:07.059918 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:07.059920 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:07.059921 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:07.060090 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:07.060189 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:07.060417 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 11:45:07.060509 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 11:45:07.063596 23545 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32922:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:45:07.066645 23545 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:45:07.081401 24178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.075327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56768 (local address 127.20.244.65:40627)
0811 11:45:07.076184 (+ 857us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:07.076195 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:07.076681 (+ 486us) server_negotiation.cc:407] Connection header received
0811 11:45:07.076912 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:07.076917 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:07.077065 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:07.077243 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:07.077668 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.078423 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.080009 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.080627 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.080747 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.080900 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:07.081150 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 11:45:07.081264 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":727,"thread_start_us":92,"threads_started":1}
I20260811 11:45:07.082042 24179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.075199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:40627 (local address 127.0.0.1:56768)
0811 11:45:07.076495 (+ 1296us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:07.076545 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:07.076749 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:07.077378 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:07.077381 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:07.077419 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:07.077558 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.077563 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.078563 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.078566 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.079873 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.079883 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.080748 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.080752 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.080869 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.080918 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 11:45:07.081705 (+ 787us) client_negotiation.cc:240] Negotiation successful
0811 11:45:07.081884 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"mutex_wait_us":181,"spinlock_wait_cycles":3840,"thread_start_us":99,"threads_started":1}
I20260811 11:45:07.082383 24180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.076051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48030 (local address 127.20.244.66:44519)
0811 11:45:07.076626 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:07.076637 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:07.076661 (+ 24us) server_negotiation.cc:407] Connection header received
0811 11:45:07.076825 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:07.076831 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:07.077034 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:07.077217 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:07.077683 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.078785 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.080539 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.081374 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.081471 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.081637 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:07.082112 (+ 475us) server_negotiation.cc:299] Negotiation successful
0811 11:45:07.082220 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":133,"threads_started":1}
I20260811 11:45:07.082792 24181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.076016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36900 (local address 127.20.244.67:40507)
0811 11:45:07.076419 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:07.076430 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:07.076721 (+ 291us) server_negotiation.cc:407] Connection header received
0811 11:45:07.076880 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:07.076885 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:07.077034 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:07.077215 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:07.077510 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.078732 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.080539 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.081357 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.081469 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.081892 (+ 423us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:07.082607 (+ 715us) server_negotiation.cc:299] Negotiation successful
0811 11:45:07.082684 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":166,"threads_started":1}
I20260811 11:45:07.083045 24177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.075242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:44519 (local address 127.0.0.1:48030)
0811 11:45:07.076496 (+ 1254us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:07.076544 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:07.076674 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:07.077384 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:07.077386 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:07.077410 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:07.077546 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.077556 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.078899 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.078902 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.080393 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.080405 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.081699 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.081703 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.081821 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.081845 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 11:45:07.081923 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 11:45:07.081994 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1142,"mutex_wait_us":122,"spinlock_wait_cycles":1280,"thread_start_us":98,"threads_started":1}
I20260811 11:45:07.083127 24176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.075552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:40507 (local address 127.0.0.1:36900)
0811 11:45:07.076495 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:07.076545 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:07.076749 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:07.077207 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:07.077213 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:07.077236 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:07.077385 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.077392 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.078885 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.078889 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.080393 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.080405 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.081961 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.081964 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.082042 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.082071 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 11:45:07.082367 (+ 296us) client_negotiation.cc:240] Negotiation successful
0811 11:45:07.082980 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":867,"mutex_wait_us":136,"spinlock_wait_cycles":768,"thread_start_us":85,"threads_started":1}
I20260811 11:45:07.085000 23713 tablet_service.cc:1467] Processing CreateTablet for tablet 5f1b383185c54aca9026fd04a869afeb (DEFAULT_TABLE table=test-table [id=121d08f014954561b5a165a73bd8e6f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:07.085301 23899 tablet_service.cc:1467] Processing CreateTablet for tablet 5f1b383185c54aca9026fd04a869afeb (DEFAULT_TABLE table=test-table [id=121d08f014954561b5a165a73bd8e6f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:07.086081 23713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f1b383185c54aca9026fd04a869afeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:07.086344 23899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f1b383185c54aca9026fd04a869afeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:07.087980 24071 tablet_service.cc:1467] Processing CreateTablet for tablet 5f1b383185c54aca9026fd04a869afeb (DEFAULT_TABLE table=test-table [id=121d08f014954561b5a165a73bd8e6f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:07.088955 24071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f1b383185c54aca9026fd04a869afeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:07.092379 24182 tablet_bootstrap.cc:492] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6: Bootstrap starting.
I20260811 11:45:07.094146 24183 tablet_bootstrap.cc:492] T 5f1b383185c54aca9026fd04a869afeb P af8d204d347244ba948cb9a487f46a64: Bootstrap starting.
I20260811 11:45:07.094833 24182 tablet_bootstrap.cc:654] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:07.095746 24182 log.cc:824] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:07.096354 24183 tablet_bootstrap.cc:654] T 5f1b383185c54aca9026fd04a869afeb P af8d204d347244ba948cb9a487f46a64: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:07.097141 24186 tablet_bootstrap.cc:492] T 5f1b383185c54aca9026fd04a869afeb P 3c3f4922132c4f2fa77d66470f48063b: Bootstrap starting.
I20260811 11:45:07.097165 24183 log.cc:824] T 5f1b383185c54aca9026fd04a869afeb P af8d204d347244ba948cb9a487f46a64: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:07.097860 24182 tablet_bootstrap.cc:492] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6: No bootstrap required, opened a new log
I20260811 11:45:07.098104 24182 ts_tablet_manager.cc:1397] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 11:45:07.099195 24186 tablet_bootstrap.cc:654] T 5f1b383185c54aca9026fd04a869afeb P 3c3f4922132c4f2fa77d66470f48063b: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:07.099308 24183 tablet_bootstrap.cc:492] T 5f1b383185c54aca9026fd04a869afeb P af8d204d347244ba948cb9a487f46a64: No bootstrap required, opened a new log
I20260811 11:45:07.099574 24183 ts_tablet_manager.cc:1397] T 5f1b383185c54aca9026fd04a869afeb P af8d204d347244ba948cb9a487f46a64: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260811 11:45:07.100111 24186 log.cc:824] T 5f1b383185c54aca9026fd04a869afeb P 3c3f4922132c4f2fa77d66470f48063b: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:07.101799 24186 tablet_bootstrap.cc:492] T 5f1b383185c54aca9026fd04a869afeb P 3c3f4922132c4f2fa77d66470f48063b: No bootstrap required, opened a new log
I20260811 11:45:07.101998 24186 ts_tablet_manager.cc:1397] T 5f1b383185c54aca9026fd04a869afeb P 3c3f4922132c4f2fa77d66470f48063b: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260811 11:45:07.103530 24183 raft_consensus.cc:348] T 5f1b383185c54aca9026fd04a869afeb P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.103530 24182 raft_consensus.cc:348] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.103798 24183 raft_consensus.cc:374] T 5f1b383185c54aca9026fd04a869afeb P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:07.103798 24182 raft_consensus.cc:374] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:07.103859 24182 raft_consensus.cc:729] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0c03d7e437c48449e95d4ebe7e2dea6, State: Initialized, Role: FOLLOWER
I20260811 11:45:07.103855 24183 raft_consensus.cc:729] T 5f1b383185c54aca9026fd04a869afeb P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af8d204d347244ba948cb9a487f46a64, State: Initialized, Role: FOLLOWER
I20260811 11:45:07.104310 24182 consensus_queue.cc:260] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.104310 24183 consensus_queue.cc:260] T 5f1b383185c54aca9026fd04a869afeb P af8d204d347244ba948cb9a487f46a64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.104969 23802 heartbeater.cc:503] Master 127.20.244.126:35389 was elected leader, sending a full tablet report...
I20260811 11:45:07.105297 24182 ts_tablet_manager.cc:1428] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20260811 11:45:07.105297 24183 ts_tablet_manager.cc:1428] T 5f1b383185c54aca9026fd04a869afeb P af8d204d347244ba948cb9a487f46a64: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 11:45:07.105618 23978 heartbeater.cc:503] Master 127.20.244.126:35389 was elected leader, sending a full tablet report...
I20260811 11:45:07.105504 24186 raft_consensus.cc:348] T 5f1b383185c54aca9026fd04a869afeb P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.105755 24186 raft_consensus.cc:374] T 5f1b383185c54aca9026fd04a869afeb P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:07.105819 24186 raft_consensus.cc:729] T 5f1b383185c54aca9026fd04a869afeb P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3f4922132c4f2fa77d66470f48063b, State: Initialized, Role: FOLLOWER
I20260811 11:45:07.106235 24186 consensus_queue.cc:260] T 5f1b383185c54aca9026fd04a869afeb P 3c3f4922132c4f2fa77d66470f48063b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.106892 24154 heartbeater.cc:503] Master 127.20.244.126:35389 was elected leader, sending a full tablet report...
I20260811 11:45:07.107251 24186 ts_tablet_manager.cc:1428] T 5f1b383185c54aca9026fd04a869afeb P 3c3f4922132c4f2fa77d66470f48063b: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260811 11:45:07.151736 24189 raft_consensus.cc:482] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:45:07.151969 24189 raft_consensus.cc:504] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.153237 24189 leader_election.cc:288] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af8d204d347244ba948cb9a487f46a64 (127.20.244.66:44519), 3c3f4922132c4f2fa77d66470f48063b (127.20.244.67:40507)
I20260811 11:45:07.157825 24180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.153600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:45765 (local address 127.20.244.66:44519)
0811 11:45:07.153726 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:07.153730 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:07.154077 (+ 347us) server_negotiation.cc:407] Connection header received
0811 11:45:07.154220 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:07.154223 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:07.154278 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:07.154364 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:07.154756 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.155508 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.156728 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.157264 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.157358 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.157399 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:07.157613 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 11:45:07.157697 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 11:45:07.157866 24192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.153506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:44519 (local address 127.20.244.65:45765)
0811 11:45:07.153948 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:07.153963 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:07.154102 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:07.154389 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:07.154392 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:07.154417 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:07.154606 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.154614 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.155630 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.155633 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.156613 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.156624 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.157377 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.157381 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.157482 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.157509 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 11:45:07.157590 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 11:45:07.157671 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"mutex_wait_us":24,"spinlock_wait_cycles":22528,"thread_start_us":152,"threads_started":1}
I20260811 11:45:07.158236 24181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.153600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:58423 (local address 127.20.244.67:40507)
0811 11:45:07.153726 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:07.153730 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:07.154076 (+ 346us) server_negotiation.cc:407] Connection header received
0811 11:45:07.154220 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:07.154223 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:07.154278 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:07.154364 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:07.155198 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.155904 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.157099 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.157605 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.157711 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.157756 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:07.158007 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 11:45:07.158101 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 11:45:07.158586 24193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.153506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:40507 (local address 127.20.244.65:58423)
0811 11:45:07.153964 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:07.153977 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:07.154102 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:07.154389 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:07.154392 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:07.154433 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:07.154606 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.154614 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.156017 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.156019 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.156974 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.156986 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.157719 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.157723 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.157822 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.157854 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 11:45:07.158396 (+ 542us) client_negotiation.cc:240] Negotiation successful
0811 11:45:07.158471 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"mutex_wait_us":65,"spinlock_wait_cycles":51200,"thread_start_us":116,"threads_started":1}
I20260811 11:45:07.158563 23922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f1b383185c54aca9026fd04a869afeb" candidate_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af8d204d347244ba948cb9a487f46a64" is_pre_election: true
I20260811 11:45:07.158864 23922 raft_consensus.cc:2454] T 5f1b383185c54aca9026fd04a869afeb P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0c03d7e437c48449e95d4ebe7e2dea6 in term 0.
I20260811 11:45:07.159377 23661 leader_election.cc:302] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0c03d7e437c48449e95d4ebe7e2dea6, af8d204d347244ba948cb9a487f46a64; no voters:
I20260811 11:45:07.159626 24096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f1b383185c54aca9026fd04a869afeb" candidate_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f4922132c4f2fa77d66470f48063b" is_pre_election: true
I20260811 11:45:07.159667 24189 raft_consensus.cc:2781] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:45:07.159759 24189 raft_consensus.cc:482] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:45:07.159829 24189 raft_consensus.cc:3037] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:07.159912 24096 raft_consensus.cc:2454] T 5f1b383185c54aca9026fd04a869afeb P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0c03d7e437c48449e95d4ebe7e2dea6 in term 0.
I20260811 11:45:07.161036 24189 raft_consensus.cc:504] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.161391 24189 leader_election.cc:288] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6 [CANDIDATE]: Term 1 election: Requested vote from peers af8d204d347244ba948cb9a487f46a64 (127.20.244.66:44519), 3c3f4922132c4f2fa77d66470f48063b (127.20.244.67:40507)
I20260811 11:45:07.161752 23922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f1b383185c54aca9026fd04a869afeb" candidate_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af8d204d347244ba948cb9a487f46a64"
I20260811 11:45:07.161752 24096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f1b383185c54aca9026fd04a869afeb" candidate_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f4922132c4f2fa77d66470f48063b"
I20260811 11:45:07.161877 24096 raft_consensus.cc:3037] T 5f1b383185c54aca9026fd04a869afeb P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:07.161877 23922 raft_consensus.cc:3037] T 5f1b383185c54aca9026fd04a869afeb P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:07.163252 23922 raft_consensus.cc:2454] T 5f1b383185c54aca9026fd04a869afeb P af8d204d347244ba948cb9a487f46a64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c03d7e437c48449e95d4ebe7e2dea6 in term 1.
I20260811 11:45:07.163552 23661 leader_election.cc:302] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0c03d7e437c48449e95d4ebe7e2dea6, af8d204d347244ba948cb9a487f46a64; no voters:
I20260811 11:45:07.163623 24096 raft_consensus.cc:2454] T 5f1b383185c54aca9026fd04a869afeb P 3c3f4922132c4f2fa77d66470f48063b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c03d7e437c48449e95d4ebe7e2dea6 in term 1.
I20260811 11:45:07.163767 24189 raft_consensus.cc:2781] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:07.163997 24189 raft_consensus.cc:686] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6 [term 1 LEADER]: Becoming Leader. State: Replica: a0c03d7e437c48449e95d4ebe7e2dea6, State: Running, Role: LEADER
I20260811 11:45:07.164311 24189 consensus_queue.cc:237] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.167626 23545 catalog_manager.cc:5495] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0c03d7e437c48449e95d4ebe7e2dea6 (127.20.244.65). New cstate: current_term: 1 leader_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } health_report { overall_health: UNKNOWN } } }
Aug 11 11:45:07 dist-test-slave-vkjp krb5kdc[23494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448706, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:07.201231 24202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.192708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:35389 (local address 127.0.0.1:32932)
0811 11:45:07.193057 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:07.193069 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:07.193202 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:07.193453 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:07.193456 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:07.193867 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:07.193967 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.193976 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.194745 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.194751 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.195385 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.195394 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.195841 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.195844 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.195985 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.196649 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:07.196661 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:07.198076 (+ 1415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:07.199652 (+ 1576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:07.199660 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:07.199665 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:07.199892 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:07.200179 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:07.200181 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:07.200182 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:07.200293 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:07.200686 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:07.200692 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:07.200795 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 11:45:07.200901 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 11:45:07.201054 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"mutex_wait_us":39,"thread_start_us":159,"threads_started":1}
I20260811 11:45:07.201251 23608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.192768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32932 (local address 127.20.244.126:35389)
0811 11:45:07.192884 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:07.192887 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:07.193144 (+ 257us) server_negotiation.cc:407] Connection header received
0811 11:45:07.193293 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:07.193297 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:07.193342 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:07.193444 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:07.194090 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.194633 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.195502 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.195716 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.195831 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.198213 (+ 2382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:07.198216 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:07.198219 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:07.198241 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:07.199556 (+ 1315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:07.200024 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:07.200027 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:07.200028 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:07.200101 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:07.200375 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:07.200377 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:07.200378 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:07.200591 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:07.200669 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:07.200962 (+ 293us) server_negotiation.cc:299] Negotiation successful
0811 11:45:07.201124 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":26}
I20260811 11:45:07.205183 23545 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:32932:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 11:45:07.205878 23545 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:45:07.211086 23713 tablet_service.cc:1467] Processing CreateTablet for tablet ca50123adce84196a297292e1c1229c2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1b38b1eb88554bf5b9effc1b8a6243a7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 11:45:07.211247 24071 tablet_service.cc:1467] Processing CreateTablet for tablet ca50123adce84196a297292e1c1229c2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1b38b1eb88554bf5b9effc1b8a6243a7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 11:45:07.211328 23899 tablet_service.cc:1467] Processing CreateTablet for tablet ca50123adce84196a297292e1c1229c2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1b38b1eb88554bf5b9effc1b8a6243a7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 11:45:07.211880 23713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca50123adce84196a297292e1c1229c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:07.211931 23899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca50123adce84196a297292e1c1229c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:07.211931 24071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca50123adce84196a297292e1c1229c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:07.214501 24182 tablet_bootstrap.cc:492] T ca50123adce84196a297292e1c1229c2 P a0c03d7e437c48449e95d4ebe7e2dea6: Bootstrap starting.
I20260811 11:45:07.214923 24186 tablet_bootstrap.cc:492] T ca50123adce84196a297292e1c1229c2 P 3c3f4922132c4f2fa77d66470f48063b: Bootstrap starting.
I20260811 11:45:07.215699 24182 tablet_bootstrap.cc:654] T ca50123adce84196a297292e1c1229c2 P a0c03d7e437c48449e95d4ebe7e2dea6: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:07.216131 24183 tablet_bootstrap.cc:492] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64: Bootstrap starting.
I20260811 11:45:07.216150 24186 tablet_bootstrap.cc:654] T ca50123adce84196a297292e1c1229c2 P 3c3f4922132c4f2fa77d66470f48063b: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:07.217026 24183 tablet_bootstrap.cc:654] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:07.217792 24186 tablet_bootstrap.cc:492] T ca50123adce84196a297292e1c1229c2 P 3c3f4922132c4f2fa77d66470f48063b: No bootstrap required, opened a new log
I20260811 11:45:07.217911 24186 ts_tablet_manager.cc:1397] T ca50123adce84196a297292e1c1229c2 P 3c3f4922132c4f2fa77d66470f48063b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 11:45:07.218394 24183 tablet_bootstrap.cc:492] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64: No bootstrap required, opened a new log
I20260811 11:45:07.218489 24183 ts_tablet_manager.cc:1397] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260811 11:45:07.218429 24186 raft_consensus.cc:348] T ca50123adce84196a297292e1c1229c2 P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.218585 24186 raft_consensus.cc:374] T ca50123adce84196a297292e1c1229c2 P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:07.218631 24186 raft_consensus.cc:729] T ca50123adce84196a297292e1c1229c2 P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3f4922132c4f2fa77d66470f48063b, State: Initialized, Role: FOLLOWER
I20260811 11:45:07.218674 24182 tablet_bootstrap.cc:492] T ca50123adce84196a297292e1c1229c2 P a0c03d7e437c48449e95d4ebe7e2dea6: No bootstrap required, opened a new log
I20260811 11:45:07.218758 24182 ts_tablet_manager.cc:1397] T ca50123adce84196a297292e1c1229c2 P a0c03d7e437c48449e95d4ebe7e2dea6: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260811 11:45:07.218778 24186 consensus_queue.cc:260] T ca50123adce84196a297292e1c1229c2 P 3c3f4922132c4f2fa77d66470f48063b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.218972 24183 raft_consensus.cc:348] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.219075 24183 raft_consensus.cc:374] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:07.219139 24183 raft_consensus.cc:729] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af8d204d347244ba948cb9a487f46a64, State: Initialized, Role: FOLLOWER
I20260811 11:45:07.219179 24186 ts_tablet_manager.cc:1428] T ca50123adce84196a297292e1c1229c2 P 3c3f4922132c4f2fa77d66470f48063b: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 11:45:07.219260 24183 consensus_queue.cc:260] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.219250 24182 raft_consensus.cc:348] T ca50123adce84196a297292e1c1229c2 P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.219363 24182 raft_consensus.cc:374] T ca50123adce84196a297292e1c1229c2 P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:07.219410 24182 raft_consensus.cc:729] T ca50123adce84196a297292e1c1229c2 P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0c03d7e437c48449e95d4ebe7e2dea6, State: Initialized, Role: FOLLOWER
I20260811 11:45:07.219538 24182 consensus_queue.cc:260] T ca50123adce84196a297292e1c1229c2 P a0c03d7e437c48449e95d4ebe7e2dea6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.219556 24190 tablet_replica.cc:439] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } } }
I20260811 11:45:07.219681 24190 tablet_replica.cc:442] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:45:07.219810 24182 ts_tablet_manager.cc:1428] T ca50123adce84196a297292e1c1229c2 P a0c03d7e437c48449e95d4ebe7e2dea6: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 11:45:07.220036 24191 tablet_replica.cc:439] T ca50123adce84196a297292e1c1229c2 P 3c3f4922132c4f2fa77d66470f48063b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } } }
I20260811 11:45:07.220186 24191 tablet_replica.cc:442] T ca50123adce84196a297292e1c1229c2 P 3c3f4922132c4f2fa77d66470f48063b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:45:07.220404 24183 ts_tablet_manager.cc:1428] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 11:45:07.220402 24189 tablet_replica.cc:439] T ca50123adce84196a297292e1c1229c2 P a0c03d7e437c48449e95d4ebe7e2dea6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } } }
I20260811 11:45:07.220531 24189 tablet_replica.cc:442] T ca50123adce84196a297292e1c1229c2 P a0c03d7e437c48449e95d4ebe7e2dea6: This TxnStatusTablet replica's current role is: FOLLOWER
W20260811 11:45:07.275229 24155 tablet.cc:2369] T 5f1b383185c54aca9026fd04a869afeb P 3c3f4922132c4f2fa77d66470f48063b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:45:07.289230 23979 tablet.cc:2369] T 5f1b383185c54aca9026fd04a869afeb P af8d204d347244ba948cb9a487f46a64: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:45:07.312983 23803 tablet.cc:2369] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:45:07.355914 24190 raft_consensus.cc:482] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:45:07.356060 24190 raft_consensus.cc:504] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.357301 24190 leader_election.cc:288] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0c03d7e437c48449e95d4ebe7e2dea6 (127.20.244.65:40627), 3c3f4922132c4f2fa77d66470f48063b (127.20.244.67:40507)
I20260811 11:45:07.361414 24208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.357554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:40507 (local address 127.20.244.66:39731)
0811 11:45:07.358022 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:07.358039 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:07.358147 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:07.358453 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:07.358455 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:07.358471 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:07.358587 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.358593 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.359390 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.359393 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.360268 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.360277 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.360910 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.360914 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.361039 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.361097 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 11:45:07.361172 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 11:45:07.361228 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"mutex_wait_us":46,"thread_start_us":79,"threads_started":1}
I20260811 11:45:07.361459 24181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.357718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:39731 (local address 127.20.244.67:40507)
0811 11:45:07.357850 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:07.357856 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:07.358149 (+ 293us) server_negotiation.cc:407] Connection header received
0811 11:45:07.358270 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:07.358274 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:07.358336 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:07.358414 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:07.358710 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.359254 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.360425 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.360793 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.360885 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.360923 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:07.361225 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 11:45:07.361339 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 11:45:07.361476 24209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.357537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:40627 (local address 127.20.244.66:47695)
0811 11:45:07.357913 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:07.357926 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:07.358026 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:07.358303 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:07.358306 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:07.358322 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:07.358469 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.358477 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.359351 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.359356 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.360252 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.360261 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.361049 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.361052 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.361139 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.361186 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 11:45:07.361263 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 11:45:07.361328 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":35,"thread_start_us":102,"threads_started":1}
I20260811 11:45:07.361488 24178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.357617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:47695 (local address 127.20.244.65:40627)
0811 11:45:07.357751 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:07.357756 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:07.358010 (+ 254us) server_negotiation.cc:407] Connection header received
0811 11:45:07.358133 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:07.358137 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:07.358195 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:07.358281 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:07.358595 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.359237 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.360380 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.360903 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.361045 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.361099 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:07.361294 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 11:45:07.361366 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 11:45:07.361912 24096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca50123adce84196a297292e1c1229c2" candidate_uuid: "af8d204d347244ba948cb9a487f46a64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f4922132c4f2fa77d66470f48063b" is_pre_election: true
I20260811 11:45:07.362073 24096 raft_consensus.cc:2454] T ca50123adce84196a297292e1c1229c2 P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af8d204d347244ba948cb9a487f46a64 in term 0.
I20260811 11:45:07.362105 23747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca50123adce84196a297292e1c1229c2" candidate_uuid: "af8d204d347244ba948cb9a487f46a64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" is_pre_election: true
I20260811 11:45:07.362360 23747 raft_consensus.cc:2454] T ca50123adce84196a297292e1c1229c2 P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af8d204d347244ba948cb9a487f46a64 in term 0.
I20260811 11:45:07.362433 23835 leader_election.cc:302] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3f4922132c4f2fa77d66470f48063b, af8d204d347244ba948cb9a487f46a64; no voters:
I20260811 11:45:07.362797 24190 raft_consensus.cc:2781] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:45:07.362866 24190 raft_consensus.cc:482] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:45:07.362906 24190 raft_consensus.cc:3037] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:07.363933 24190 raft_consensus.cc:504] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.364276 24190 leader_election.cc:288] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64 [CANDIDATE]: Term 1 election: Requested vote from peers a0c03d7e437c48449e95d4ebe7e2dea6 (127.20.244.65:40627), 3c3f4922132c4f2fa77d66470f48063b (127.20.244.67:40507)
I20260811 11:45:07.364641 24096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca50123adce84196a297292e1c1229c2" candidate_uuid: "af8d204d347244ba948cb9a487f46a64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f4922132c4f2fa77d66470f48063b"
I20260811 11:45:07.364632 23747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca50123adce84196a297292e1c1229c2" candidate_uuid: "af8d204d347244ba948cb9a487f46a64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6"
I20260811 11:45:07.364751 24096 raft_consensus.cc:3037] T ca50123adce84196a297292e1c1229c2 P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:07.364751 23747 raft_consensus.cc:3037] T ca50123adce84196a297292e1c1229c2 P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:07.365899 24096 raft_consensus.cc:2454] T ca50123adce84196a297292e1c1229c2 P 3c3f4922132c4f2fa77d66470f48063b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af8d204d347244ba948cb9a487f46a64 in term 1.
I20260811 11:45:07.365928 23747 raft_consensus.cc:2454] T ca50123adce84196a297292e1c1229c2 P a0c03d7e437c48449e95d4ebe7e2dea6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af8d204d347244ba948cb9a487f46a64 in term 1.
I20260811 11:45:07.366180 23836 leader_election.cc:302] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0c03d7e437c48449e95d4ebe7e2dea6, af8d204d347244ba948cb9a487f46a64; no voters:
I20260811 11:45:07.366358 24190 raft_consensus.cc:2781] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:07.366554 24190 raft_consensus.cc:686] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64 [term 1 LEADER]: Becoming Leader. State: Replica: af8d204d347244ba948cb9a487f46a64, State: Running, Role: LEADER
I20260811 11:45:07.366904 24190 consensus_queue.cc:237] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.369697 24210 tablet_replica.cc:439] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64: TxnStatusTablet state changed. Reason: New leader af8d204d347244ba948cb9a487f46a64. Latest consensus state: current_term: 1 leader_uuid: "af8d204d347244ba948cb9a487f46a64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } } }
I20260811 11:45:07.369814 24210 tablet_replica.cc:442] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64: This TxnStatusTablet replica's current role is: LEADER
I20260811 11:45:07.370141 24212 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 11:45:07.370375 24212 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 11:45:07.370548 23546 catalog_manager.cc:5495] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64 reported cstate change: term changed from 0 to 1, leader changed from <none> to af8d204d347244ba948cb9a487f46a64 (127.20.244.66). New cstate: current_term: 1 leader_uuid: "af8d204d347244ba948cb9a487f46a64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } health_report { overall_health: UNKNOWN } } }
I20260811 11:45:07.416370 24202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.412557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:44519 (local address 127.0.0.1:48046)
0811 11:45:07.412750 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:07.412771 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:07.412920 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:07.413273 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:07.413276 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:07.413284 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 11:45:07.413397 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.413402 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.414140 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.414143 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.414742 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.414750 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.415269 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.415273 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.415374 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.415417 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 11:45:07.416076 (+ 659us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 11:45:07.416093 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 11:45:07.416163 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 11:45:07.416246 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 11:45:07.416370 24180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.412704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48046 (local address 127.20.244.66:44519)
0811 11:45:07.412857 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:07.412862 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:07.412877 (+ 15us) server_negotiation.cc:407] Connection header received
0811 11:45:07.413095 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:07.413098 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:07.413153 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:07.413257 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:45:07.413505 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.414015 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.414877 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.415156 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.415265 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.415565 (+ 300us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:45:07.415978 (+ 413us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:45:07.416103 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:07.416172 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 11:45:07.416222 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 11:45:07.421336 24096 raft_consensus.cc:1261] T ca50123adce84196a297292e1c1229c2 P 3c3f4922132c4f2fa77d66470f48063b [term 1 FOLLOWER]: Refusing update from remote peer af8d204d347244ba948cb9a487f46a64: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:07.421339 23747 raft_consensus.cc:1261] T ca50123adce84196a297292e1c1229c2 P a0c03d7e437c48449e95d4ebe7e2dea6 [term 1 FOLLOWER]: Refusing update from remote peer af8d204d347244ba948cb9a487f46a64: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:07.422024 24210 consensus_queue.cc:1035] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:07.422230 24190 consensus_queue.cc:1035] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:07.425417 24189 tablet_replica.cc:439] T ca50123adce84196a297292e1c1229c2 P a0c03d7e437c48449e95d4ebe7e2dea6: TxnStatusTablet state changed. Reason: New leader af8d204d347244ba948cb9a487f46a64. Latest consensus state: current_term: 1 leader_uuid: "af8d204d347244ba948cb9a487f46a64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } } }
I20260811 11:45:07.425541 24189 tablet_replica.cc:442] T ca50123adce84196a297292e1c1229c2 P a0c03d7e437c48449e95d4ebe7e2dea6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:45:07.425549 24191 tablet_replica.cc:439] T ca50123adce84196a297292e1c1229c2 P 3c3f4922132c4f2fa77d66470f48063b: TxnStatusTablet state changed. Reason: New leader af8d204d347244ba948cb9a487f46a64. Latest consensus state: current_term: 1 leader_uuid: "af8d204d347244ba948cb9a487f46a64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } } }
I20260811 11:45:07.425663 24191 tablet_replica.cc:442] T ca50123adce84196a297292e1c1229c2 P 3c3f4922132c4f2fa77d66470f48063b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:45:07.428665 24190 tablet_replica.cc:439] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "af8d204d347244ba948cb9a487f46a64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } } }
I20260811 11:45:07.428784 24190 tablet_replica.cc:442] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64: This TxnStatusTablet replica's current role is: LEADER
I20260811 11:45:07.429203 24190 tablet_replica.cc:439] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "af8d204d347244ba948cb9a487f46a64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } } }
I20260811 11:45:07.429322 24190 tablet_replica.cc:442] T ca50123adce84196a297292e1c1229c2 P af8d204d347244ba948cb9a487f46a64: This TxnStatusTablet replica's current role is: LEADER
I20260811 11:45:07.429860 24189 tablet_replica.cc:439] T ca50123adce84196a297292e1c1229c2 P a0c03d7e437c48449e95d4ebe7e2dea6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "af8d204d347244ba948cb9a487f46a64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } } }
I20260811 11:45:07.429963 24189 tablet_replica.cc:442] T ca50123adce84196a297292e1c1229c2 P a0c03d7e437c48449e95d4ebe7e2dea6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:45:07.432117 24191 tablet_replica.cc:439] T ca50123adce84196a297292e1c1229c2 P 3c3f4922132c4f2fa77d66470f48063b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "af8d204d347244ba948cb9a487f46a64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } } }
I20260811 11:45:07.432233 24191 tablet_replica.cc:442] T ca50123adce84196a297292e1c1229c2 P 3c3f4922132c4f2fa77d66470f48063b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:45:07.432723 24217 mvcc.cc:205] Tried to move back new op lower bound from 7317293905591238656 to 7317293905377513472. Current Snapshot: MvccSnapshot[applied={T|T < 7317293905591238656}]
I20260811 11:45:07.432863 24218 mvcc.cc:205] Tried to move back new op lower bound from 7317293905591238656 to 7317293905377513472. Current Snapshot: MvccSnapshot[applied={T|T < 7317293905591238656}]
I20260811 11:45:07.442301 24178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.438467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56772 (local address 127.20.244.65:40627)
0811 11:45:07.438840 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:07.438843 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:07.438853 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:45:07.438913 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:07.438915 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:07.438968 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:07.439078 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:45:07.439409 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.439917 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.440785 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.441056 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.441169 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.441468 (+ 299us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:45:07.441905 (+ 437us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:45:07.442043 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:07.442100 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 11:45:07.442155 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291}
I20260811 11:45:07.454767 24228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.450120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:44519 (local address 127.20.244.65:59741)
0811 11:45:07.450603 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:07.450620 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:07.450804 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:07.451431 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:07.451434 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:07.451463 (+ 29us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 11:45:07.451607 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.451618 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.452795 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.452799 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.453441 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.453450 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.453942 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.453946 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.454044 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.454089 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 11:45:07.454435 (+ 346us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 11:45:07.454444 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 11:45:07.454532 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 11:45:07.454611 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":123,"threads_started":1}
I20260811 11:45:07.454741 24180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.450679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:59741 (local address 127.20.244.66:44519)
0811 11:45:07.450811 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:07.450816 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:07.450833 (+ 17us) server_negotiation.cc:407] Connection header received
0811 11:45:07.451055 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:07.451058 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:07.451160 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:07.451233 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:45:07.451770 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.452576 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.453570 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.453813 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.453931 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.454265 (+ 334us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:45:07.454347 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:45:07.454434 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:07.454546 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 11:45:07.454599 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 11:45:07.462519 24096 raft_consensus.cc:1261] T 5f1b383185c54aca9026fd04a869afeb P 3c3f4922132c4f2fa77d66470f48063b [term 1 FOLLOWER]: Refusing update from remote peer a0c03d7e437c48449e95d4ebe7e2dea6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:07.462925 23922 raft_consensus.cc:1261] T 5f1b383185c54aca9026fd04a869afeb P af8d204d347244ba948cb9a487f46a64 [term 1 FOLLOWER]: Refusing update from remote peer a0c03d7e437c48449e95d4ebe7e2dea6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:07.463629 24194 consensus_queue.cc:1035] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:07.464293 24194 consensus_queue.cc:1035] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:07.470528 24216 mvcc.cc:205] Tried to move back new op lower bound from 7317293905762217984 to 7317293904547770368. Current Snapshot: MvccSnapshot[applied={T|T < 7317293905762217984}]
I20260811 11:45:07.487982 24178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.483838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:48453 (local address 127.20.244.65:40627)
0811 11:45:07.483964 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:07.483967 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:07.484210 (+ 243us) server_negotiation.cc:407] Connection header received
0811 11:45:07.484333 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:07.484336 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:07.484375 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:07.484442 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:45:07.484726 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.485442 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.486840 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.487064 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.487211 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.487539 (+ 328us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:45:07.487615 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:45:07.487696 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:07.487785 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 11:45:07.487837 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 11:45:07.488040 24238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:07.483764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:40627 (local address 127.20.244.66:48453)
0811 11:45:07.484127 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:07.484142 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:07.484249 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:07.484472 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:07.484475 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:07.484483 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 11:45:07.484607 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.484614 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.485714 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.485718 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.486705 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:07.486717 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:07.487223 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:07.487226 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:07.487327 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:07.487380 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 11:45:07.487700 (+ 320us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 11:45:07.487710 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 11:45:07.487776 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 11:45:07.487856 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":104,"threads_started":1}
I20260811 11:45:07.515015 23546 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32922:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:07.515239 23546 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32922:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:07.518035 23546 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824: Sending DeleteTablet for 3 replicas of tablet 5f1b383185c54aca9026fd04a869afeb
I20260811 11:45:07.518759 23899 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f1b383185c54aca9026fd04a869afeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:07 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:48030
I20260811 11:45:07.519244 24071 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f1b383185c54aca9026fd04a869afeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:07 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:36900
I20260811 11:45:07.519726 23546 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32922:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 11:45:07.519898 23713 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f1b383185c54aca9026fd04a869afeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:07 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:56768
W20260811 11:45:07.520144 23546 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:45:07.520517 24242 tablet_replica.cc:330] T 5f1b383185c54aca9026fd04a869afeb P af8d204d347244ba948cb9a487f46a64: stopping tablet replica
I20260811 11:45:07.520884 24242 raft_consensus.cc:2229] T 5f1b383185c54aca9026fd04a869afeb P af8d204d347244ba948cb9a487f46a64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:07.521132 24242 raft_consensus.cc:2258] T 5f1b383185c54aca9026fd04a869afeb P af8d204d347244ba948cb9a487f46a64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:07.521443 24245 tablet_replica.cc:330] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6: stopping tablet replica
I20260811 11:45:07.521729 24245 raft_consensus.cc:2229] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:45:07.522096 24245 raft_consensus.cc:2258] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:07.523546 24242 ts_tablet_manager.cc:1905] T 5f1b383185c54aca9026fd04a869afeb P af8d204d347244ba948cb9a487f46a64: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:07.524670 24245 ts_tablet_manager.cc:1905] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:07.525127 23899 tablet_service.cc:1467] Processing CreateTablet for tablet fd140bb1982947ce8fadd26ab2bdeb5d (DEFAULT_TABLE table=test-table [id=8a1edb57d2104bac8fe11a1220eb64db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:07.525417 23899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd140bb1982947ce8fadd26ab2bdeb5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:07.527949 24183 tablet_bootstrap.cc:492] T fd140bb1982947ce8fadd26ab2bdeb5d P af8d204d347244ba948cb9a487f46a64: Bootstrap starting.
I20260811 11:45:07.528851 24183 tablet_bootstrap.cc:654] T fd140bb1982947ce8fadd26ab2bdeb5d P af8d204d347244ba948cb9a487f46a64: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:07.528862 23713 tablet_service.cc:1467] Processing CreateTablet for tablet fd140bb1982947ce8fadd26ab2bdeb5d (DEFAULT_TABLE table=test-table [id=8a1edb57d2104bac8fe11a1220eb64db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:07.529121 23713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd140bb1982947ce8fadd26ab2bdeb5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:07.530606 24242 ts_tablet_manager.cc:1918] T 5f1b383185c54aca9026fd04a869afeb P af8d204d347244ba948cb9a487f46a64: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:45:07.530742 24242 log.cc:1196] T 5f1b383185c54aca9026fd04a869afeb P af8d204d347244ba948cb9a487f46a64: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/5f1b383185c54aca9026fd04a869afeb
I20260811 11:45:07.531220 24245 ts_tablet_manager.cc:1918] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:45:07.531664 24242 ts_tablet_manager.cc:1939] T 5f1b383185c54aca9026fd04a869afeb P af8d204d347244ba948cb9a487f46a64: Deleting consensus metadata
I20260811 11:45:07.531910 24243 tablet_replica.cc:330] T 5f1b383185c54aca9026fd04a869afeb P 3c3f4922132c4f2fa77d66470f48063b: stopping tablet replica
I20260811 11:45:07.532133 24071 tablet_service.cc:1467] Processing CreateTablet for tablet fd140bb1982947ce8fadd26ab2bdeb5d (DEFAULT_TABLE table=test-table [id=8a1edb57d2104bac8fe11a1220eb64db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:07.532418 24071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd140bb1982947ce8fadd26ab2bdeb5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:07.531386 24182 tablet_bootstrap.cc:492] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6: Bootstrap starting.
I20260811 11:45:07.533437 24182 tablet_bootstrap.cc:654] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:07.534154 24245 log.cc:1196] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-0/wal/wals/5f1b383185c54aca9026fd04a869afeb
I20260811 11:45:07.534335 24243 raft_consensus.cc:2229] T 5f1b383185c54aca9026fd04a869afeb P 3c3f4922132c4f2fa77d66470f48063b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:07.535537 23533 catalog_manager.cc:4841] TS af8d204d347244ba948cb9a487f46a64 (127.20.244.66:44519): tablet 5f1b383185c54aca9026fd04a869afeb (table test-table [id=121d08f014954561b5a165a73bd8e6f8]) successfully deleted
I20260811 11:45:07.536062 24245 ts_tablet_manager.cc:1939] T 5f1b383185c54aca9026fd04a869afeb P a0c03d7e437c48449e95d4ebe7e2dea6: Deleting consensus metadata
I20260811 11:45:07.534672 24186 tablet_bootstrap.cc:492] T fd140bb1982947ce8fadd26ab2bdeb5d P 3c3f4922132c4f2fa77d66470f48063b: Bootstrap starting.
I20260811 11:45:07.537004 24186 tablet_bootstrap.cc:654] T fd140bb1982947ce8fadd26ab2bdeb5d P 3c3f4922132c4f2fa77d66470f48063b: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:07.537729 24243 raft_consensus.cc:2258] T 5f1b383185c54aca9026fd04a869afeb P 3c3f4922132c4f2fa77d66470f48063b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:07.539283 24186 tablet_bootstrap.cc:492] T fd140bb1982947ce8fadd26ab2bdeb5d P 3c3f4922132c4f2fa77d66470f48063b: No bootstrap required, opened a new log
I20260811 11:45:07.539372 24186 ts_tablet_manager.cc:1397] T fd140bb1982947ce8fadd26ab2bdeb5d P 3c3f4922132c4f2fa77d66470f48063b: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 11:45:07.539813 24186 raft_consensus.cc:348] T fd140bb1982947ce8fadd26ab2bdeb5d P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.539950 24186 raft_consensus.cc:374] T fd140bb1982947ce8fadd26ab2bdeb5d P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:07.539990 24186 raft_consensus.cc:729] T fd140bb1982947ce8fadd26ab2bdeb5d P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3f4922132c4f2fa77d66470f48063b, State: Initialized, Role: FOLLOWER
I20260811 11:45:07.540110 24186 consensus_queue.cc:260] T fd140bb1982947ce8fadd26ab2bdeb5d P 3c3f4922132c4f2fa77d66470f48063b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.540256 23532 catalog_manager.cc:4841] TS a0c03d7e437c48449e95d4ebe7e2dea6 (127.20.244.65:40627): tablet 5f1b383185c54aca9026fd04a869afeb (table test-table [id=121d08f014954561b5a165a73bd8e6f8]) successfully deleted
I20260811 11:45:07.540390 24186 ts_tablet_manager.cc:1428] T fd140bb1982947ce8fadd26ab2bdeb5d P 3c3f4922132c4f2fa77d66470f48063b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:07.541260 24243 ts_tablet_manager.cc:1905] T 5f1b383185c54aca9026fd04a869afeb P 3c3f4922132c4f2fa77d66470f48063b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:07.543926 24182 tablet_bootstrap.cc:492] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6: No bootstrap required, opened a new log
I20260811 11:45:07.544018 24182 ts_tablet_manager.cc:1397] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.001s
I20260811 11:45:07.544445 24182 raft_consensus.cc:348] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.544560 24182 raft_consensus.cc:374] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:07.544592 24182 raft_consensus.cc:729] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0c03d7e437c48449e95d4ebe7e2dea6, State: Initialized, Role: FOLLOWER
I20260811 11:45:07.544739 24182 consensus_queue.cc:260] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.544983 24183 tablet_bootstrap.cc:492] T fd140bb1982947ce8fadd26ab2bdeb5d P af8d204d347244ba948cb9a487f46a64: No bootstrap required, opened a new log
I20260811 11:45:07.545018 24182 ts_tablet_manager.cc:1428] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 11:45:07.545066 24183 ts_tablet_manager.cc:1397] T fd140bb1982947ce8fadd26ab2bdeb5d P af8d204d347244ba948cb9a487f46a64: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.000s
I20260811 11:45:07.545501 24183 raft_consensus.cc:348] T fd140bb1982947ce8fadd26ab2bdeb5d P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.545642 24183 raft_consensus.cc:374] T fd140bb1982947ce8fadd26ab2bdeb5d P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:07.545683 24183 raft_consensus.cc:729] T fd140bb1982947ce8fadd26ab2bdeb5d P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af8d204d347244ba948cb9a487f46a64, State: Initialized, Role: FOLLOWER
I20260811 11:45:07.545835 24183 consensus_queue.cc:260] T fd140bb1982947ce8fadd26ab2bdeb5d P af8d204d347244ba948cb9a487f46a64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.546021 24243 ts_tablet_manager.cc:1918] T 5f1b383185c54aca9026fd04a869afeb P 3c3f4922132c4f2fa77d66470f48063b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:45:07.546130 24183 ts_tablet_manager.cc:1428] T fd140bb1982947ce8fadd26ab2bdeb5d P af8d204d347244ba948cb9a487f46a64: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:07.546152 24243 log.cc:1196] T 5f1b383185c54aca9026fd04a869afeb P 3c3f4922132c4f2fa77d66470f48063b: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/5f1b383185c54aca9026fd04a869afeb
I20260811 11:45:07.546572 24243 ts_tablet_manager.cc:1939] T 5f1b383185c54aca9026fd04a869afeb P 3c3f4922132c4f2fa77d66470f48063b: Deleting consensus metadata
I20260811 11:45:07.547839 23531 catalog_manager.cc:4841] TS 3c3f4922132c4f2fa77d66470f48063b (127.20.244.67:40507): tablet 5f1b383185c54aca9026fd04a869afeb (table test-table [id=121d08f014954561b5a165a73bd8e6f8]) successfully deleted
I20260811 11:45:07.554032 24235 raft_consensus.cc:482] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:45:07.554141 24235 raft_consensus.cc:504] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.554531 24235 leader_election.cc:288] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af8d204d347244ba948cb9a487f46a64 (127.20.244.66:44519), 3c3f4922132c4f2fa77d66470f48063b (127.20.244.67:40507)
I20260811 11:45:07.554942 23922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd140bb1982947ce8fadd26ab2bdeb5d" candidate_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af8d204d347244ba948cb9a487f46a64" is_pre_election: true
I20260811 11:45:07.554984 24096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd140bb1982947ce8fadd26ab2bdeb5d" candidate_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f4922132c4f2fa77d66470f48063b" is_pre_election: true
I20260811 11:45:07.555131 24096 raft_consensus.cc:2454] T fd140bb1982947ce8fadd26ab2bdeb5d P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0c03d7e437c48449e95d4ebe7e2dea6 in term 0.
I20260811 11:45:07.555088 23922 raft_consensus.cc:2454] T fd140bb1982947ce8fadd26ab2bdeb5d P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0c03d7e437c48449e95d4ebe7e2dea6 in term 0.
I20260811 11:45:07.555429 23659 leader_election.cc:302] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3f4922132c4f2fa77d66470f48063b, a0c03d7e437c48449e95d4ebe7e2dea6; no voters:
I20260811 11:45:07.555656 24235 raft_consensus.cc:2781] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:45:07.555728 24235 raft_consensus.cc:482] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:45:07.555783 24235 raft_consensus.cc:3037] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:07.556932 24235 raft_consensus.cc:504] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.557318 24235 leader_election.cc:288] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6 [CANDIDATE]: Term 1 election: Requested vote from peers af8d204d347244ba948cb9a487f46a64 (127.20.244.66:44519), 3c3f4922132c4f2fa77d66470f48063b (127.20.244.67:40507)
I20260811 11:45:07.557569 23922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd140bb1982947ce8fadd26ab2bdeb5d" candidate_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af8d204d347244ba948cb9a487f46a64"
I20260811 11:45:07.557632 24096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd140bb1982947ce8fadd26ab2bdeb5d" candidate_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f4922132c4f2fa77d66470f48063b"
I20260811 11:45:07.557675 23922 raft_consensus.cc:3037] T fd140bb1982947ce8fadd26ab2bdeb5d P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:07.557730 24096 raft_consensus.cc:3037] T fd140bb1982947ce8fadd26ab2bdeb5d P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:07.558684 23922 raft_consensus.cc:2454] T fd140bb1982947ce8fadd26ab2bdeb5d P af8d204d347244ba948cb9a487f46a64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c03d7e437c48449e95d4ebe7e2dea6 in term 1.
I20260811 11:45:07.558759 24096 raft_consensus.cc:2454] T fd140bb1982947ce8fadd26ab2bdeb5d P 3c3f4922132c4f2fa77d66470f48063b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c03d7e437c48449e95d4ebe7e2dea6 in term 1.
I20260811 11:45:07.559010 23661 leader_election.cc:302] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0c03d7e437c48449e95d4ebe7e2dea6, af8d204d347244ba948cb9a487f46a64; no voters:
I20260811 11:45:07.559192 24235 raft_consensus.cc:2781] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:07.559278 24235 raft_consensus.cc:686] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6 [term 1 LEADER]: Becoming Leader. State: Replica: a0c03d7e437c48449e95d4ebe7e2dea6, State: Running, Role: LEADER
I20260811 11:45:07.559401 24235 consensus_queue.cc:237] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:07.560966 23545 catalog_manager.cc:5495] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0c03d7e437c48449e95d4ebe7e2dea6 (127.20.244.65). New cstate: current_term: 1 leader_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } health_report { overall_health: UNKNOWN } } }
I20260811 11:45:07.577873 23922 raft_consensus.cc:1261] T fd140bb1982947ce8fadd26ab2bdeb5d P af8d204d347244ba948cb9a487f46a64 [term 1 FOLLOWER]: Refusing update from remote peer a0c03d7e437c48449e95d4ebe7e2dea6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:07.578023 24095 raft_consensus.cc:1261] T fd140bb1982947ce8fadd26ab2bdeb5d P 3c3f4922132c4f2fa77d66470f48063b [term 1 FOLLOWER]: Refusing update from remote peer a0c03d7e437c48449e95d4ebe7e2dea6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:07.578521 24189 consensus_queue.cc:1035] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:07.578794 24189 consensus_queue.cc:1035] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 11:45:07.602989 24218 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 11:45:09.157896 23544 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32922:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:09.158082 23544 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32922:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:09.160884 23544 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824: Sending DeleteTablet for 3 replicas of tablet fd140bb1982947ce8fadd26ab2bdeb5d
I20260811 11:45:09.161540 23899 tablet_service.cc:1514] Processing DeleteTablet for tablet fd140bb1982947ce8fadd26ab2bdeb5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:09 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:48030
I20260811 11:45:09.161723 23713 tablet_service.cc:1514] Processing DeleteTablet for tablet fd140bb1982947ce8fadd26ab2bdeb5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:09 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:56768
I20260811 11:45:09.161916 24071 tablet_service.cc:1514] Processing DeleteTablet for tablet fd140bb1982947ce8fadd26ab2bdeb5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:09 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:36900
I20260811 11:45:09.162052 24281 tablet_replica.cc:330] T fd140bb1982947ce8fadd26ab2bdeb5d P af8d204d347244ba948cb9a487f46a64: stopping tablet replica
I20260811 11:45:09.162232 24283 tablet_replica.cc:330] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6: stopping tablet replica
I20260811 11:45:09.162232 24281 raft_consensus.cc:2229] T fd140bb1982947ce8fadd26ab2bdeb5d P af8d204d347244ba948cb9a487f46a64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:09.162410 24283 raft_consensus.cc:2229] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:45:09.162420 24281 raft_consensus.cc:2258] T fd140bb1982947ce8fadd26ab2bdeb5d P af8d204d347244ba948cb9a487f46a64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:09.162642 24283 raft_consensus.cc:2258] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:09.163218 24281 ts_tablet_manager.cc:1905] T fd140bb1982947ce8fadd26ab2bdeb5d P af8d204d347244ba948cb9a487f46a64: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:09.163431 24283 ts_tablet_manager.cc:1905] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:09.164640 24284 tablet_replica.cc:330] T fd140bb1982947ce8fadd26ab2bdeb5d P 3c3f4922132c4f2fa77d66470f48063b: stopping tablet replica
I20260811 11:45:09.164781 24284 raft_consensus.cc:2229] T fd140bb1982947ce8fadd26ab2bdeb5d P 3c3f4922132c4f2fa77d66470f48063b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:09.164909 24284 raft_consensus.cc:2258] T fd140bb1982947ce8fadd26ab2bdeb5d P 3c3f4922132c4f2fa77d66470f48063b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:09.166318 24284 ts_tablet_manager.cc:1905] T fd140bb1982947ce8fadd26ab2bdeb5d P 3c3f4922132c4f2fa77d66470f48063b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:09.166656 24283 ts_tablet_manager.cc:1918] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 11:45:09.166761 24283 log.cc:1196] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-0/wal/wals/fd140bb1982947ce8fadd26ab2bdeb5d
I20260811 11:45:09.166790 24281 ts_tablet_manager.cc:1918] T fd140bb1982947ce8fadd26ab2bdeb5d P af8d204d347244ba948cb9a487f46a64: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 11:45:09.166909 24281 log.cc:1196] T fd140bb1982947ce8fadd26ab2bdeb5d P af8d204d347244ba948cb9a487f46a64: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/fd140bb1982947ce8fadd26ab2bdeb5d
I20260811 11:45:09.167282 24281 ts_tablet_manager.cc:1939] T fd140bb1982947ce8fadd26ab2bdeb5d P af8d204d347244ba948cb9a487f46a64: Deleting consensus metadata
I20260811 11:45:09.168033 23533 catalog_manager.cc:4841] TS af8d204d347244ba948cb9a487f46a64 (127.20.244.66:44519): tablet fd140bb1982947ce8fadd26ab2bdeb5d (table test-table [id=8a1edb57d2104bac8fe11a1220eb64db]) successfully deleted
I20260811 11:45:09.168254 24283 ts_tablet_manager.cc:1939] T fd140bb1982947ce8fadd26ab2bdeb5d P a0c03d7e437c48449e95d4ebe7e2dea6: Deleting consensus metadata
I20260811 11:45:09.168973 23532 catalog_manager.cc:4841] TS a0c03d7e437c48449e95d4ebe7e2dea6 (127.20.244.65:40627): tablet fd140bb1982947ce8fadd26ab2bdeb5d (table test-table [id=8a1edb57d2104bac8fe11a1220eb64db]) successfully deleted
I20260811 11:45:09.169692 24284 ts_tablet_manager.cc:1918] T fd140bb1982947ce8fadd26ab2bdeb5d P 3c3f4922132c4f2fa77d66470f48063b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 11:45:09.169816 24284 log.cc:1196] T fd140bb1982947ce8fadd26ab2bdeb5d P 3c3f4922132c4f2fa77d66470f48063b: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/fd140bb1982947ce8fadd26ab2bdeb5d
I20260811 11:45:09.170167 24284 ts_tablet_manager.cc:1939] T fd140bb1982947ce8fadd26ab2bdeb5d P 3c3f4922132c4f2fa77d66470f48063b: Deleting consensus metadata
I20260811 11:45:09.170962 23531 catalog_manager.cc:4841] TS 3c3f4922132c4f2fa77d66470f48063b (127.20.244.67:40507): tablet fd140bb1982947ce8fadd26ab2bdeb5d (table test-table [id=8a1edb57d2104bac8fe11a1220eb64db]) successfully deleted
Aug 11 11:45:09 dist-test-slave-vkjp krb5kdc[23494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448709, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 11:45:09 dist-test-slave-vkjp krb5kdc[23494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448709, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:09.198298 24292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:09.185435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32934 (local address 127.20.244.126:35389)
0811 11:45:09.185741 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:09.185753 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:09.185772 (+ 19us) server_negotiation.cc:407] Connection header received
0811 11:45:09.185986 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:09.185988 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:09.186036 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:09.186132 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:09.186852 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:09.187507 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:09.188374 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:09.188610 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:09.188725 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:09.195154 (+ 6429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:09.195158 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:09.195160 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:09.195188 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:09.196514 (+ 1326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:09.196953 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:09.196959 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:09.196961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:09.197046 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:09.197329 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:09.197333 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:09.197335 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:09.197531 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:09.197680 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:09.197976 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 11:45:09.198116 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":107,"threads_started":1}
I20260811 11:45:09.201117 23544 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:32934:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:45:09.201606 23544 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:45:09.206645 23713 tablet_service.cc:1467] Processing CreateTablet for tablet 94f232b5ac03452d81f27e0a02853a7a (DEFAULT_TABLE table=test-table [id=f20355c555d241d6bdc24f5a8ff8f9bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:09.206650 23899 tablet_service.cc:1467] Processing CreateTablet for tablet 94f232b5ac03452d81f27e0a02853a7a (DEFAULT_TABLE table=test-table [id=f20355c555d241d6bdc24f5a8ff8f9bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:09.206713 24071 tablet_service.cc:1467] Processing CreateTablet for tablet 94f232b5ac03452d81f27e0a02853a7a (DEFAULT_TABLE table=test-table [id=f20355c555d241d6bdc24f5a8ff8f9bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:09.206974 23899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94f232b5ac03452d81f27e0a02853a7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:09.206974 24071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94f232b5ac03452d81f27e0a02853a7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:09.206981 23713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94f232b5ac03452d81f27e0a02853a7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:09.209072 24293 tablet_bootstrap.cc:492] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6: Bootstrap starting.
I20260811 11:45:09.209476 24294 tablet_bootstrap.cc:492] T 94f232b5ac03452d81f27e0a02853a7a P af8d204d347244ba948cb9a487f46a64: Bootstrap starting.
I20260811 11:45:09.210086 24295 tablet_bootstrap.cc:492] T 94f232b5ac03452d81f27e0a02853a7a P 3c3f4922132c4f2fa77d66470f48063b: Bootstrap starting.
I20260811 11:45:09.210246 24293 tablet_bootstrap.cc:654] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:09.210304 24294 tablet_bootstrap.cc:654] T 94f232b5ac03452d81f27e0a02853a7a P af8d204d347244ba948cb9a487f46a64: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:09.211030 24295 tablet_bootstrap.cc:654] T 94f232b5ac03452d81f27e0a02853a7a P 3c3f4922132c4f2fa77d66470f48063b: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:09.211664 24294 tablet_bootstrap.cc:492] T 94f232b5ac03452d81f27e0a02853a7a P af8d204d347244ba948cb9a487f46a64: No bootstrap required, opened a new log
I20260811 11:45:09.211684 24293 tablet_bootstrap.cc:492] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6: No bootstrap required, opened a new log
I20260811 11:45:09.211803 24293 ts_tablet_manager.cc:1397] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 11:45:09.211795 24294 ts_tablet_manager.cc:1397] T 94f232b5ac03452d81f27e0a02853a7a P af8d204d347244ba948cb9a487f46a64: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 11:45:09.212196 24293 raft_consensus.cc:348] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:09.212196 24294 raft_consensus.cc:348] T 94f232b5ac03452d81f27e0a02853a7a P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:09.212314 24293 raft_consensus.cc:374] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:09.212321 24294 raft_consensus.cc:374] T 94f232b5ac03452d81f27e0a02853a7a P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:09.212354 24293 raft_consensus.cc:729] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0c03d7e437c48449e95d4ebe7e2dea6, State: Initialized, Role: FOLLOWER
I20260811 11:45:09.212357 24294 raft_consensus.cc:729] T 94f232b5ac03452d81f27e0a02853a7a P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af8d204d347244ba948cb9a487f46a64, State: Initialized, Role: FOLLOWER
I20260811 11:45:09.212513 24293 consensus_queue.cc:260] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:09.212513 24294 consensus_queue.cc:260] T 94f232b5ac03452d81f27e0a02853a7a P af8d204d347244ba948cb9a487f46a64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:09.212694 24295 tablet_bootstrap.cc:492] T 94f232b5ac03452d81f27e0a02853a7a P 3c3f4922132c4f2fa77d66470f48063b: No bootstrap required, opened a new log
I20260811 11:45:09.212778 24295 ts_tablet_manager.cc:1397] T 94f232b5ac03452d81f27e0a02853a7a P 3c3f4922132c4f2fa77d66470f48063b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 11:45:09.212842 24293 ts_tablet_manager.cc:1428] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:09.212949 24294 ts_tablet_manager.cc:1428] T 94f232b5ac03452d81f27e0a02853a7a P af8d204d347244ba948cb9a487f46a64: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 11:45:09.213231 24295 raft_consensus.cc:348] T 94f232b5ac03452d81f27e0a02853a7a P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:09.213356 24295 raft_consensus.cc:374] T 94f232b5ac03452d81f27e0a02853a7a P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:09.213399 24295 raft_consensus.cc:729] T 94f232b5ac03452d81f27e0a02853a7a P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3f4922132c4f2fa77d66470f48063b, State: Initialized, Role: FOLLOWER
I20260811 11:45:09.213544 24295 consensus_queue.cc:260] T 94f232b5ac03452d81f27e0a02853a7a P 3c3f4922132c4f2fa77d66470f48063b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:09.213955 24295 ts_tablet_manager.cc:1428] T 94f232b5ac03452d81f27e0a02853a7a P 3c3f4922132c4f2fa77d66470f48063b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:09.326987 24274 raft_consensus.cc:482] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:45:09.327176 24274 raft_consensus.cc:504] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:09.327673 24274 leader_election.cc:288] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af8d204d347244ba948cb9a487f46a64 (127.20.244.66:44519), 3c3f4922132c4f2fa77d66470f48063b (127.20.244.67:40507)
I20260811 11:45:09.328203 23922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94f232b5ac03452d81f27e0a02853a7a" candidate_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af8d204d347244ba948cb9a487f46a64" is_pre_election: true
I20260811 11:45:09.328222 24096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94f232b5ac03452d81f27e0a02853a7a" candidate_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f4922132c4f2fa77d66470f48063b" is_pre_election: true
I20260811 11:45:09.328378 23922 raft_consensus.cc:2454] T 94f232b5ac03452d81f27e0a02853a7a P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0c03d7e437c48449e95d4ebe7e2dea6 in term 0.
I20260811 11:45:09.328485 24096 raft_consensus.cc:2454] T 94f232b5ac03452d81f27e0a02853a7a P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0c03d7e437c48449e95d4ebe7e2dea6 in term 0.
I20260811 11:45:09.328820 23661 leader_election.cc:302] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0c03d7e437c48449e95d4ebe7e2dea6, af8d204d347244ba948cb9a487f46a64; no voters:
I20260811 11:45:09.329025 24274 raft_consensus.cc:2781] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:45:09.329088 24274 raft_consensus.cc:482] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:45:09.329159 24274 raft_consensus.cc:3037] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:09.330197 24274 raft_consensus.cc:504] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:09.330592 24274 leader_election.cc:288] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6 [CANDIDATE]: Term 1 election: Requested vote from peers af8d204d347244ba948cb9a487f46a64 (127.20.244.66:44519), 3c3f4922132c4f2fa77d66470f48063b (127.20.244.67:40507)
I20260811 11:45:09.330992 23922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94f232b5ac03452d81f27e0a02853a7a" candidate_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af8d204d347244ba948cb9a487f46a64"
I20260811 11:45:09.331063 24096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94f232b5ac03452d81f27e0a02853a7a" candidate_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c3f4922132c4f2fa77d66470f48063b"
I20260811 11:45:09.331161 23922 raft_consensus.cc:3037] T 94f232b5ac03452d81f27e0a02853a7a P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:09.331246 24096 raft_consensus.cc:3037] T 94f232b5ac03452d81f27e0a02853a7a P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:09.332310 23922 raft_consensus.cc:2454] T 94f232b5ac03452d81f27e0a02853a7a P af8d204d347244ba948cb9a487f46a64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c03d7e437c48449e95d4ebe7e2dea6 in term 1.
I20260811 11:45:09.332562 24096 raft_consensus.cc:2454] T 94f232b5ac03452d81f27e0a02853a7a P 3c3f4922132c4f2fa77d66470f48063b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c03d7e437c48449e95d4ebe7e2dea6 in term 1.
I20260811 11:45:09.332578 23661 leader_election.cc:302] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0c03d7e437c48449e95d4ebe7e2dea6, af8d204d347244ba948cb9a487f46a64; no voters:
I20260811 11:45:09.332787 24274 raft_consensus.cc:2781] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:09.332902 24274 raft_consensus.cc:686] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6 [term 1 LEADER]: Becoming Leader. State: Replica: a0c03d7e437c48449e95d4ebe7e2dea6, State: Running, Role: LEADER
I20260811 11:45:09.333055 24274 consensus_queue.cc:237] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:09.334954 23546 catalog_manager.cc:5495] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0c03d7e437c48449e95d4ebe7e2dea6 (127.20.244.65). New cstate: current_term: 1 leader_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } health_report { overall_health: UNKNOWN } } }
I20260811 11:45:09.375502 24304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:09.371856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56774 (local address 127.20.244.65:40627)
0811 11:45:09.372178 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:09.372189 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:09.372201 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:45:09.372250 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:09.372252 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:09.372294 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:09.372425 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:45:09.372700 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:09.373297 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:09.374323 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:09.374569 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:09.374681 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:09.374954 (+ 273us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:45:09.375036 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:45:09.375192 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:09.375290 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 11:45:09.375343 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":114,"threads_started":1}
I20260811 11:45:09.381515 23922 raft_consensus.cc:1261] T 94f232b5ac03452d81f27e0a02853a7a P af8d204d347244ba948cb9a487f46a64 [term 1 FOLLOWER]: Refusing update from remote peer a0c03d7e437c48449e95d4ebe7e2dea6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:09.381894 24194 consensus_queue.cc:1035] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:09.382004 24096 raft_consensus.cc:1261] T 94f232b5ac03452d81f27e0a02853a7a P 3c3f4922132c4f2fa77d66470f48063b [term 1 FOLLOWER]: Refusing update from remote peer a0c03d7e437c48449e95d4ebe7e2dea6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:09.382354 24194 consensus_queue.cc:1035] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:09.412436 23545 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:32934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:09.412614 23545 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:32934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:09.414587 23545 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824: Sending DeleteTablet for 3 replicas of tablet 94f232b5ac03452d81f27e0a02853a7a
I20260811 11:45:09.415140 23713 tablet_service.cc:1514] Processing DeleteTablet for tablet 94f232b5ac03452d81f27e0a02853a7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:09 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:56768
I20260811 11:45:09.415225 23899 tablet_service.cc:1514] Processing DeleteTablet for tablet 94f232b5ac03452d81f27e0a02853a7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:09 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:48030
I20260811 11:45:09.415320 24071 tablet_service.cc:1514] Processing DeleteTablet for tablet 94f232b5ac03452d81f27e0a02853a7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:09 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:36900
I20260811 11:45:09.415432 24281 tablet_replica.cc:330] T 94f232b5ac03452d81f27e0a02853a7a P af8d204d347244ba948cb9a487f46a64: stopping tablet replica
I20260811 11:45:09.415532 24283 tablet_replica.cc:330] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6: stopping tablet replica
I20260811 11:45:09.415563 24281 raft_consensus.cc:2229] T 94f232b5ac03452d81f27e0a02853a7a P af8d204d347244ba948cb9a487f46a64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:09.415607 24284 tablet_replica.cc:330] T 94f232b5ac03452d81f27e0a02853a7a P 3c3f4922132c4f2fa77d66470f48063b: stopping tablet replica
I20260811 11:45:09.415634 24283 raft_consensus.cc:2229] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:45:09.415669 24281 raft_consensus.cc:2258] T 94f232b5ac03452d81f27e0a02853a7a P af8d204d347244ba948cb9a487f46a64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:09.415729 24284 raft_consensus.cc:2229] T 94f232b5ac03452d81f27e0a02853a7a P 3c3f4922132c4f2fa77d66470f48063b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:09.415798 24283 raft_consensus.cc:2258] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:09.415848 24284 raft_consensus.cc:2258] T 94f232b5ac03452d81f27e0a02853a7a P 3c3f4922132c4f2fa77d66470f48063b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:09.415807 23545 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:32934:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:45:09.416360 23545 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:45:09.416455 24281 ts_tablet_manager.cc:1905] T 94f232b5ac03452d81f27e0a02853a7a P af8d204d347244ba948cb9a487f46a64: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:09.416548 24283 ts_tablet_manager.cc:1905] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:09.419061 24283 ts_tablet_manager.cc:1918] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:45:09.419061 24281 ts_tablet_manager.cc:1918] T 94f232b5ac03452d81f27e0a02853a7a P af8d204d347244ba948cb9a487f46a64: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:45:09.419171 24281 log.cc:1196] T 94f232b5ac03452d81f27e0a02853a7a P af8d204d347244ba948cb9a487f46a64: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/94f232b5ac03452d81f27e0a02853a7a
I20260811 11:45:09.419171 24283 log.cc:1196] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-0/wal/wals/94f232b5ac03452d81f27e0a02853a7a
I20260811 11:45:09.419447 24281 ts_tablet_manager.cc:1939] T 94f232b5ac03452d81f27e0a02853a7a P af8d204d347244ba948cb9a487f46a64: Deleting consensus metadata
I20260811 11:45:09.419452 24283 ts_tablet_manager.cc:1939] T 94f232b5ac03452d81f27e0a02853a7a P a0c03d7e437c48449e95d4ebe7e2dea6: Deleting consensus metadata
I20260811 11:45:09.420120 23533 catalog_manager.cc:4841] TS af8d204d347244ba948cb9a487f46a64 (127.20.244.66:44519): tablet 94f232b5ac03452d81f27e0a02853a7a (table test-table [id=f20355c555d241d6bdc24f5a8ff8f9bc]) successfully deleted
I20260811 11:45:09.420501 24284 ts_tablet_manager.cc:1905] T 94f232b5ac03452d81f27e0a02853a7a P 3c3f4922132c4f2fa77d66470f48063b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:09.420833 23532 catalog_manager.cc:4841] TS a0c03d7e437c48449e95d4ebe7e2dea6 (127.20.244.65:40627): tablet 94f232b5ac03452d81f27e0a02853a7a (table test-table [id=f20355c555d241d6bdc24f5a8ff8f9bc]) successfully deleted
I20260811 11:45:09.421485 23713 tablet_service.cc:1467] Processing CreateTablet for tablet 92cb69417e784a18b8bbe83cd5b70857 (DEFAULT_TABLE table=test-table [id=53f96102567e4e5aaafda6d01cb87e79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:09.421693 24071 tablet_service.cc:1467] Processing CreateTablet for tablet 92cb69417e784a18b8bbe83cd5b70857 (DEFAULT_TABLE table=test-table [id=53f96102567e4e5aaafda6d01cb87e79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:09.421693 23899 tablet_service.cc:1467] Processing CreateTablet for tablet 92cb69417e784a18b8bbe83cd5b70857 (DEFAULT_TABLE table=test-table [id=53f96102567e4e5aaafda6d01cb87e79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:09.421749 23713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92cb69417e784a18b8bbe83cd5b70857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:09.421944 23899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92cb69417e784a18b8bbe83cd5b70857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:09.421944 24071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92cb69417e784a18b8bbe83cd5b70857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:09.423022 24284 ts_tablet_manager.cc:1918] T 94f232b5ac03452d81f27e0a02853a7a P 3c3f4922132c4f2fa77d66470f48063b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:45:09.423118 24284 log.cc:1196] T 94f232b5ac03452d81f27e0a02853a7a P 3c3f4922132c4f2fa77d66470f48063b: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/94f232b5ac03452d81f27e0a02853a7a
I20260811 11:45:09.423408 24284 ts_tablet_manager.cc:1939] T 94f232b5ac03452d81f27e0a02853a7a P 3c3f4922132c4f2fa77d66470f48063b: Deleting consensus metadata
I20260811 11:45:09.424095 24293 tablet_bootstrap.cc:492] T 92cb69417e784a18b8bbe83cd5b70857 P a0c03d7e437c48449e95d4ebe7e2dea6: Bootstrap starting.
I20260811 11:45:09.424187 24294 tablet_bootstrap.cc:492] T 92cb69417e784a18b8bbe83cd5b70857 P af8d204d347244ba948cb9a487f46a64: Bootstrap starting.
I20260811 11:45:09.424544 23531 catalog_manager.cc:4841] TS 3c3f4922132c4f2fa77d66470f48063b (127.20.244.67:40507): tablet 94f232b5ac03452d81f27e0a02853a7a (table test-table [id=f20355c555d241d6bdc24f5a8ff8f9bc]) successfully deleted
I20260811 11:45:09.424933 24293 tablet_bootstrap.cc:654] T 92cb69417e784a18b8bbe83cd5b70857 P a0c03d7e437c48449e95d4ebe7e2dea6: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:09.424933 24294 tablet_bootstrap.cc:654] T 92cb69417e784a18b8bbe83cd5b70857 P af8d204d347244ba948cb9a487f46a64: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:09.425505 24295 tablet_bootstrap.cc:492] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b: Bootstrap starting.
I20260811 11:45:09.426226 24294 tablet_bootstrap.cc:492] T 92cb69417e784a18b8bbe83cd5b70857 P af8d204d347244ba948cb9a487f46a64: No bootstrap required, opened a new log
I20260811 11:45:09.426321 24294 ts_tablet_manager.cc:1397] T 92cb69417e784a18b8bbe83cd5b70857 P af8d204d347244ba948cb9a487f46a64: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 11:45:09.426542 24295 tablet_bootstrap.cc:654] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:09.426786 24294 raft_consensus.cc:348] T 92cb69417e784a18b8bbe83cd5b70857 P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:09.426934 24294 raft_consensus.cc:374] T 92cb69417e784a18b8bbe83cd5b70857 P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:09.426970 24294 raft_consensus.cc:729] T 92cb69417e784a18b8bbe83cd5b70857 P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af8d204d347244ba948cb9a487f46a64, State: Initialized, Role: FOLLOWER
I20260811 11:45:09.427544 24293 tablet_bootstrap.cc:492] T 92cb69417e784a18b8bbe83cd5b70857 P a0c03d7e437c48449e95d4ebe7e2dea6: No bootstrap required, opened a new log
I20260811 11:45:09.427639 24293 ts_tablet_manager.cc:1397] T 92cb69417e784a18b8bbe83cd5b70857 P a0c03d7e437c48449e95d4ebe7e2dea6: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 11:45:09.427733 24295 tablet_bootstrap.cc:492] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b: No bootstrap required, opened a new log
I20260811 11:45:09.427811 24295 ts_tablet_manager.cc:1397] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:09.428063 24293 raft_consensus.cc:348] T 92cb69417e784a18b8bbe83cd5b70857 P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:09.428179 24293 raft_consensus.cc:374] T 92cb69417e784a18b8bbe83cd5b70857 P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:09.428228 24293 raft_consensus.cc:729] T 92cb69417e784a18b8bbe83cd5b70857 P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0c03d7e437c48449e95d4ebe7e2dea6, State: Initialized, Role: FOLLOWER
I20260811 11:45:09.428225 24295 raft_consensus.cc:348] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:09.428334 24295 raft_consensus.cc:374] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:09.428391 24295 raft_consensus.cc:729] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3f4922132c4f2fa77d66470f48063b, State: Initialized, Role: FOLLOWER
I20260811 11:45:09.428362 24293 consensus_queue.cc:260] T 92cb69417e784a18b8bbe83cd5b70857 P a0c03d7e437c48449e95d4ebe7e2dea6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:09.428515 24295 consensus_queue.cc:260] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:09.428656 24293 ts_tablet_manager.cc:1428] T 92cb69417e784a18b8bbe83cd5b70857 P a0c03d7e437c48449e95d4ebe7e2dea6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:09.428762 24295 ts_tablet_manager.cc:1428] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 11:45:09.428843 24294 consensus_queue.cc:260] T 92cb69417e784a18b8bbe83cd5b70857 P af8d204d347244ba948cb9a487f46a64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:09.429133 24294 ts_tablet_manager.cc:1428] T 92cb69417e784a18b8bbe83cd5b70857 P af8d204d347244ba948cb9a487f46a64: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 11:45:09.471218 24300 raft_consensus.cc:482] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:45:09.471381 24300 raft_consensus.cc:504] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:09.472503 24300 leader_election.cc:288] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0c03d7e437c48449e95d4ebe7e2dea6 (127.20.244.65:40627), af8d204d347244ba948cb9a487f46a64 (127.20.244.66:44519)
I20260811 11:45:09.477167 24314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:09.472897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:47227 (local address 127.20.244.66:44519)
0811 11:45:09.473161 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:09.473176 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:09.473477 (+ 301us) server_negotiation.cc:407] Connection header received
0811 11:45:09.473598 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:09.473601 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:09.473653 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:09.473747 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:09.474088 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:09.474933 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:09.476130 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:09.476550 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:09.476678 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:09.476732 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:09.476935 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 11:45:09.477020 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":86,"threads_started":1}
I20260811 11:45:09.477180 24304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:09.472785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:40879 (local address 127.20.244.65:40627)
0811 11:45:09.472978 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:09.472985 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:09.473463 (+ 478us) server_negotiation.cc:407] Connection header received
0811 11:45:09.473661 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:09.473664 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:09.473730 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:09.473805 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:09.474202 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:09.474946 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:09.476138 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:09.476557 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:09.476693 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:09.476747 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:09.476988 (+ 241us) server_negotiation.cc:299] Negotiation successful
0811 11:45:09.477073 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 11:45:09.477162 24313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:09.472733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:44519 (local address 127.20.244.67:47227)
0811 11:45:09.473346 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:09.473363 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:09.473494 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:09.473786 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:09.473792 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:09.473812 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:09.473965 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:09.473972 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:09.475052 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:09.475054 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:09.475997 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:09.476007 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:09.476676 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:09.476680 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:09.476782 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:09.476830 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 11:45:09.476892 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 11:45:09.476983 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"mutex_wait_us":59,"thread_start_us":100,"threads_started":1}
I20260811 11:45:09.477169 24315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:09.472918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:40627 (local address 127.20.244.67:40879)
0811 11:45:09.473376 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:09.473392 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:09.473516 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:09.473934 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:09.473937 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:09.473957 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:09.474077 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:09.474082 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:09.475147 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:09.475150 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:09.476000 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:09.476010 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:09.476702 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:09.476706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:09.476834 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:09.476851 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 11:45:09.476954 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 11:45:09.477019 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":401,"mutex_wait_us":23,"thread_start_us":94,"threads_started":1}
I20260811 11:45:09.477620 23922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92cb69417e784a18b8bbe83cd5b70857" candidate_uuid: "3c3f4922132c4f2fa77d66470f48063b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af8d204d347244ba948cb9a487f46a64" is_pre_election: true
I20260811 11:45:09.477770 23922 raft_consensus.cc:2454] T 92cb69417e784a18b8bbe83cd5b70857 P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c3f4922132c4f2fa77d66470f48063b in term 0.
I20260811 11:45:09.478058 23747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92cb69417e784a18b8bbe83cd5b70857" candidate_uuid: "3c3f4922132c4f2fa77d66470f48063b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" is_pre_election: true
I20260811 11:45:09.478116 24010 leader_election.cc:302] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3f4922132c4f2fa77d66470f48063b, af8d204d347244ba948cb9a487f46a64; no voters:
I20260811 11:45:09.478201 23747 raft_consensus.cc:2454] T 92cb69417e784a18b8bbe83cd5b70857 P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c3f4922132c4f2fa77d66470f48063b in term 0.
I20260811 11:45:09.478406 24300 raft_consensus.cc:2781] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:45:09.478494 24300 raft_consensus.cc:482] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:45:09.478549 24300 raft_consensus.cc:3037] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:09.479661 24300 raft_consensus.cc:504] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:09.479997 24300 leader_election.cc:288] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b [CANDIDATE]: Term 1 election: Requested vote from peers a0c03d7e437c48449e95d4ebe7e2dea6 (127.20.244.65:40627), af8d204d347244ba948cb9a487f46a64 (127.20.244.66:44519)
I20260811 11:45:09.480298 23747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92cb69417e784a18b8bbe83cd5b70857" candidate_uuid: "3c3f4922132c4f2fa77d66470f48063b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6"
I20260811 11:45:09.480409 23747 raft_consensus.cc:3037] T 92cb69417e784a18b8bbe83cd5b70857 P a0c03d7e437c48449e95d4ebe7e2dea6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:09.480355 23922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92cb69417e784a18b8bbe83cd5b70857" candidate_uuid: "3c3f4922132c4f2fa77d66470f48063b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af8d204d347244ba948cb9a487f46a64"
I20260811 11:45:09.480563 23922 raft_consensus.cc:3037] T 92cb69417e784a18b8bbe83cd5b70857 P af8d204d347244ba948cb9a487f46a64 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:09.481474 23747 raft_consensus.cc:2454] T 92cb69417e784a18b8bbe83cd5b70857 P a0c03d7e437c48449e95d4ebe7e2dea6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3f4922132c4f2fa77d66470f48063b in term 1.
I20260811 11:45:09.481676 23922 raft_consensus.cc:2454] T 92cb69417e784a18b8bbe83cd5b70857 P af8d204d347244ba948cb9a487f46a64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c3f4922132c4f2fa77d66470f48063b in term 1.
I20260811 11:45:09.481809 24009 leader_election.cc:302] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c3f4922132c4f2fa77d66470f48063b, a0c03d7e437c48449e95d4ebe7e2dea6; no voters:
I20260811 11:45:09.481986 24300 raft_consensus.cc:2781] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:09.482177 24300 raft_consensus.cc:686] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b [term 1 LEADER]: Becoming Leader. State: Replica: 3c3f4922132c4f2fa77d66470f48063b, State: Running, Role: LEADER
I20260811 11:45:09.482417 24300 consensus_queue.cc:237] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } }
I20260811 11:45:09.484658 23543 catalog_manager.cc:5495] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c3f4922132c4f2fa77d66470f48063b (127.20.244.67). New cstate: current_term: 1 leader_uuid: "3c3f4922132c4f2fa77d66470f48063b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c3f4922132c4f2fa77d66470f48063b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 40507 } health_report { overall_health: HEALTHY } } }
I20260811 11:45:09.514840 24318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:09.510965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36906 (local address 127.20.244.67:40507)
0811 11:45:09.511346 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:09.511355 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:09.511366 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:45:09.511437 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:09.511439 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:09.511489 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:09.511624 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:45:09.511880 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:09.512449 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:09.513271 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:09.513522 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:09.513632 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:09.513923 (+ 291us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:45:09.514410 (+ 487us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:45:09.514536 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:09.514614 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 11:45:09.514669 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":175,"threads_started":1}
I20260811 11:45:09.524904 24321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:09.521252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:44519 (local address 127.20.244.67:37185)
0811 11:45:09.521595 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:09.521608 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:09.521691 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:09.521899 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:09.521901 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:09.521907 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 11:45:09.522510 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:09.522518 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:09.523273 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:09.523275 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:09.523873 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:09.523881 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:09.524287 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:09.524289 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:09.524358 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:09.524397 (+ 39us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 11:45:09.524639 (+ 242us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 11:45:09.524644 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 11:45:09.524691 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 11:45:09.524765 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":165,"threads_started":1}
I20260811 11:45:09.524909 24314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:09.521374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:37185 (local address 127.20.244.66:44519)
0811 11:45:09.521501 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:09.521504 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:09.521676 (+ 172us) server_negotiation.cc:407] Connection header received
0811 11:45:09.521770 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:09.521772 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:09.521814 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:09.521876 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:45:09.522616 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:09.523179 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:09.523975 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:09.524179 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:09.524252 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:09.524508 (+ 256us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:45:09.524568 (+ 60us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:45:09.524620 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:09.524717 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 11:45:09.524789 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 11:45:09.530411 23922 raft_consensus.cc:1261] T 92cb69417e784a18b8bbe83cd5b70857 P af8d204d347244ba948cb9a487f46a64 [term 1 FOLLOWER]: Refusing update from remote peer 3c3f4922132c4f2fa77d66470f48063b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:09.530468 23747 raft_consensus.cc:1261] T 92cb69417e784a18b8bbe83cd5b70857 P a0c03d7e437c48449e95d4ebe7e2dea6 [term 1 FOLLOWER]: Refusing update from remote peer 3c3f4922132c4f2fa77d66470f48063b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:09.530846 24300 consensus_queue.cc:1035] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af8d204d347244ba948cb9a487f46a64" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:09.531118 24316 consensus_queue.cc:1035] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0c03d7e437c48449e95d4ebe7e2dea6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:09.548411 24327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:09.545074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:40507 (local address 127.20.244.66:40465)
0811 11:45:09.545330 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:09.545345 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:09.545439 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:09.545695 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:09.545698 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:09.545706 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 11:45:09.545825 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:09.545830 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:09.546546 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:09.546551 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:09.547243 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:09.547253 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:09.547715 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:09.547719 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:09.547816 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:09.547846 (+ 30us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 11:45:09.548131 (+ 285us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 11:45:09.548140 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 11:45:09.548202 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 11:45:09.548283 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":107,"threads_started":1}
I20260811 11:45:09.548404 24318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:09.545129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:40465 (local address 127.20.244.67:40507)
0811 11:45:09.545265 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:09.545272 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:09.545430 (+ 158us) server_negotiation.cc:407] Connection header received
0811 11:45:09.545543 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:09.545546 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:09.545594 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:09.545673 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:45:09.545928 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:09.546437 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:09.547364 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:09.547601 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:09.547712 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:09.547967 (+ 255us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:45:09.548045 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:45:09.548123 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:09.548212 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 11:45:09.548262 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
W20260811 11:45:09.549232 24260 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 11:45:11.108167 23546 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:32934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:11.108330 23546 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:32934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:11.110744 23546 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 50fc8094ae02492fad220ee4cc93a824: Sending DeleteTablet for 3 replicas of tablet 92cb69417e784a18b8bbe83cd5b70857
I20260811 11:45:11.111361 23713 tablet_service.cc:1514] Processing DeleteTablet for tablet 92cb69417e784a18b8bbe83cd5b70857 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:11 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:56768
I20260811 11:45:11.111418 23899 tablet_service.cc:1514] Processing DeleteTablet for tablet 92cb69417e784a18b8bbe83cd5b70857 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:11 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:48030
I20260811 11:45:11.111650 24071 tablet_service.cc:1514] Processing DeleteTablet for tablet 92cb69417e784a18b8bbe83cd5b70857 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:11 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:36900
I20260811 11:45:11.111780 24359 tablet_replica.cc:330] T 92cb69417e784a18b8bbe83cd5b70857 P af8d204d347244ba948cb9a487f46a64: stopping tablet replica
I20260811 11:45:11.111917 24359 raft_consensus.cc:2229] T 92cb69417e784a18b8bbe83cd5b70857 P af8d204d347244ba948cb9a487f46a64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:11.111922 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 23638
I20260811 11:45:11.113921 24359 raft_consensus.cc:2258] T 92cb69417e784a18b8bbe83cd5b70857 P af8d204d347244ba948cb9a487f46a64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:11.114825 24359 ts_tablet_manager.cc:1905] T 92cb69417e784a18b8bbe83cd5b70857 P af8d204d347244ba948cb9a487f46a64: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:11.115228 24360 tablet_replica.cc:330] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b: stopping tablet replica
I20260811 11:45:11.115353 24360 raft_consensus.cc:2229] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:45:11.115645 24360 raft_consensus.cc:2258] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:11.116271 24360 ts_tablet_manager.cc:1905] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:11.117600 24359 ts_tablet_manager.cc:1918] T 92cb69417e784a18b8bbe83cd5b70857 P af8d204d347244ba948cb9a487f46a64: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 11:45:11.117694 24359 log.cc:1196] T 92cb69417e784a18b8bbe83cd5b70857 P af8d204d347244ba948cb9a487f46a64: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/92cb69417e784a18b8bbe83cd5b70857
I20260811 11:45:11.117996 24359 ts_tablet_manager.cc:1939] T 92cb69417e784a18b8bbe83cd5b70857 P af8d204d347244ba948cb9a487f46a64: Deleting consensus metadata
I20260811 11:45:11.118894 23533 catalog_manager.cc:4841] TS af8d204d347244ba948cb9a487f46a64 (127.20.244.66:44519): tablet 92cb69417e784a18b8bbe83cd5b70857 (table test-table [id=53f96102567e4e5aaafda6d01cb87e79]) successfully deleted
I20260811 11:45:11.119082 24360 ts_tablet_manager.cc:1918] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 11:45:11.119181 24360 log.cc:1196] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/92cb69417e784a18b8bbe83cd5b70857
I20260811 11:45:11.119452 24360 ts_tablet_manager.cc:1939] T 92cb69417e784a18b8bbe83cd5b70857 P 3c3f4922132c4f2fa77d66470f48063b: Deleting consensus metadata
I20260811 11:45:11.120085 23531 catalog_manager.cc:4841] TS 3c3f4922132c4f2fa77d66470f48063b (127.20.244.67:40507): tablet 92cb69417e784a18b8bbe83cd5b70857 (table test-table [id=53f96102567e4e5aaafda6d01cb87e79]) successfully deleted
W20260811 11:45:11.126642 23532 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.244.65:40627 (error 108)
I20260811 11:45:11.126883 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 23815
I20260811 11:45:11.130155 24362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:11.129691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:40627 (local address 127.0.0.1:55834)
0811 11:45:11.129979 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:11.130071 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.65:40627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":147,"threads_started":1}
W20260811 11:45:11.130290 23532 catalog_manager.cc:4584] TS a0c03d7e437c48449e95d4ebe7e2dea6 (127.20.244.65:40627): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 92cb69417e784a18b8bbe83cd5b70857: Network error: Client connection negotiation failed: client connection to 127.20.244.65:40627: connect: Connection refused (error 111)
I20260811 11:45:11.135421 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 23987
I20260811 11:45:11.146274 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 23509
2026-08-11T11:45:11Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6313 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:45:11 dist-test-slave-vkjp krb5kdc[24365](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:45:11 dist-test-slave-vkjp krb5kdc[24365](info): set up 2 sockets
Aug 11 11:45:11 dist-test-slave-vkjp krb5kdc[24365](info): commencing operation
krb5kdc: starting...
W20260811 11:45:12.373705 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.200s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:45:12 dist-test-slave-vkjp krb5kdc[24365](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448712, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:45:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:45:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:45:12.520602 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:42801
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:44591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:42801
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:12.635601 24379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:12.635933 24379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:12.636020 24379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:12.640461 24379 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:12.640575 24379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:12.640617 24379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:12.640676 24379 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:12.640713 24379 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:45:12.646278 24379 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:44591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:42801
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:42801
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24379
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:12.647575 24379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:12.648653 24379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:12.658061 24385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:12.658133 24379 server_base.cc:1034] running on GCE node
W20260811 11:45:12.658077 24386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:12.658073 24389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:12.658828 24379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:12.660044 24379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:12.661293 24379 hybrid_clock.cc:648] HybridClock initialized: now 1786448712661271 us; error 35 us; skew 500 ppm
Aug 11 11:45:12 dist-test-slave-vkjp krb5kdc[24365](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448712, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:12.664326 24379 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:45:12.665264 24379 webserver.cc:460] Webserver started at http://127.20.244.126:38479/ using document root <none> and password file <none>
I20260811 11:45:12.665858 24379 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:12.665956 24379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:12.666195 24379 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:12.668398 24379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "e6bf74e113524e1e9900af4cc74bc743"
format_stamp: "Formatted at 2026-08-11 11:45:12 on dist-test-slave-vkjp"
server_key: "4bc89c90b68005b57631a5ca403d2939"
server_key_iv: "7c89dfebd47525b2965158448fdc76b9"
server_key_version: "encryptionkey@0"
I20260811 11:45:12.668987 24379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "e6bf74e113524e1e9900af4cc74bc743"
format_stamp: "Formatted at 2026-08-11 11:45:12 on dist-test-slave-vkjp"
server_key: "4bc89c90b68005b57631a5ca403d2939"
server_key_iv: "7c89dfebd47525b2965158448fdc76b9"
server_key_version: "encryptionkey@0"
I20260811 11:45:12.673005 24379 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 11:45:12.675410 24396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:12.676661 24379 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 11:45:12.676829 24379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "e6bf74e113524e1e9900af4cc74bc743"
format_stamp: "Formatted at 2026-08-11 11:45:12 on dist-test-slave-vkjp"
server_key: "4bc89c90b68005b57631a5ca403d2939"
server_key_iv: "7c89dfebd47525b2965158448fdc76b9"
server_key_version: "encryptionkey@0"
I20260811 11:45:12.676950 24379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:12.692063 24379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:12.695490 24379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:12.695711 24379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:12.703126 24379 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:42801
I20260811 11:45:12.703155 24459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:42801 every 8 connection(s)
I20260811 11:45:12.704097 24379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:45:12.706799 24460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:12.707897 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 24379
I20260811 11:45:12.708022 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:45:12.708348 21457 external_mini_cluster.cc:1428] Setting key 61e2b6ba9caa2f9f5c1b8fe06a170313
I20260811 11:45:12.712963 24460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743: Bootstrap starting.
I20260811 11:45:12.715229 24460 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:12.715957 24460 log.cc:824] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743: Log is configured to *not* fsync() on all Append() calls
Aug 11 11:45:12 dist-test-slave-vkjp krb5kdc[24365](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448712, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:12.718226 24460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743: No bootstrap required, opened a new log
I20260811 11:45:12.722244 24460 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6bf74e113524e1e9900af4cc74bc743" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 42801 } }
I20260811 11:45:12.722489 24460 raft_consensus.cc:374] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:12.722569 24460 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6bf74e113524e1e9900af4cc74bc743, State: Initialized, Role: FOLLOWER
I20260811 11:45:12.722738 24465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:12.709820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50216 (local address 127.20.244.126:42801)
0811 11:45:12.710258 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:12.710273 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:12.710307 (+ 34us) server_negotiation.cc:407] Connection header received
0811 11:45:12.710939 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:12.710955 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:12.711359 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:12.711683 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:12.712510 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:12.713544 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:12.714394 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:12.714866 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:12.715040 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:12.717990 (+ 2950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:12.717995 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:12.718007 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:12.718033 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:12.719794 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:12.720347 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:12.720351 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:12.720356 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:12.720462 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:12.720750 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:12.720752 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:12.720753 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:12.721147 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:12.721314 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:12.721600 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 11:45:12.721924 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":143,"threads_started":1}
I20260811 11:45:12.723076 24460 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6bf74e113524e1e9900af4cc74bc743" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 42801 } }
I20260811 11:45:12.723249 24460 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:45:12.723323 24460 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:45:12.723416 24460 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:12.724347 24460 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6bf74e113524e1e9900af4cc74bc743" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 42801 } }
I20260811 11:45:12.724684 24460 leader_election.cc:302] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6bf74e113524e1e9900af4cc74bc743; no voters:
I20260811 11:45:12.725044 24460 leader_election.cc:288] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:45:12.725158 24467 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:12.725479 24467 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743 [term 1 LEADER]: Becoming Leader. State: Replica: e6bf74e113524e1e9900af4cc74bc743, State: Running, Role: LEADER
I20260811 11:45:12.725857 24467 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6bf74e113524e1e9900af4cc74bc743" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 42801 } }
I20260811 11:45:12.726293 24460 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:45:12.727495 24468 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e6bf74e113524e1e9900af4cc74bc743" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6bf74e113524e1e9900af4cc74bc743" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 42801 } } }
I20260811 11:45:12.727625 24468 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:12.727964 24469 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6bf74e113524e1e9900af4cc74bc743. Latest consensus state: current_term: 1 leader_uuid: "e6bf74e113524e1e9900af4cc74bc743" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6bf74e113524e1e9900af4cc74bc743" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 42801 } } }
I20260811 11:45:12.728041 24478 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:45:12.728150 24469 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:12.731429 24478 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:45:12.736342 24478 catalog_manager.cc:1347] Generated new cluster ID: 8e432e29f7a34d80803c018b24dbe14a
I20260811 11:45:12.736402 24478 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:45:12.751559 24478 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:45:12.752465 24478 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:45:12.758098 24478 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e6bf74e113524e1e9900af4cc74bc743: Generated new TSK 0
I20260811 11:45:12.758808 24478 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.244.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
I20260811 11:45:12.794328 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:42801
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:44591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:12.907261 24491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:12.907518 24491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:12.907562 24491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:12.911844 24491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:12.911902 24491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:12.911996 24491 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:45:12.917197 24491 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:44591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:42801
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:12.918241 24491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:12.919332 24491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:12.929349 24501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:12.929409 24491 server_base.cc:1034] running on GCE node
W20260811 11:45:12.929340 24498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:12.929318 24496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:12.929962 24491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:12.930629 24491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:12.931811 24491 hybrid_clock.cc:648] HybridClock initialized: now 1786448712931802 us; error 96 us; skew 500 ppm
Aug 11 11:45:12 dist-test-slave-vkjp krb5kdc[24365](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448712, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:12.934435 24491 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:45:12.935328 24491 webserver.cc:460] Webserver started at http://127.20.244.65:42417/ using document root <none> and password file <none>
I20260811 11:45:12.935881 24491 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:12.935972 24491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:12.936205 24491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:12.938179 24491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "ce818ff0b9d748b7a5f0e93066c2b019"
format_stamp: "Formatted at 2026-08-11 11:45:12 on dist-test-slave-vkjp"
server_key: "3392805af555feeb57a1bf47b8a78822"
server_key_iv: "fbaa5bbdf22757adc2e58ae3ba749be9"
server_key_version: "encryptionkey@0"
I20260811 11:45:12.938766 24491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "ce818ff0b9d748b7a5f0e93066c2b019"
format_stamp: "Formatted at 2026-08-11 11:45:12 on dist-test-slave-vkjp"
server_key: "3392805af555feeb57a1bf47b8a78822"
server_key_iv: "fbaa5bbdf22757adc2e58ae3ba749be9"
server_key_version: "encryptionkey@0"
I20260811 11:45:12.942461 24491 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260811 11:45:12.944871 24512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:12.946061 24491 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:12.946283 24491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "ce818ff0b9d748b7a5f0e93066c2b019"
format_stamp: "Formatted at 2026-08-11 11:45:12 on dist-test-slave-vkjp"
server_key: "3392805af555feeb57a1bf47b8a78822"
server_key_iv: "fbaa5bbdf22757adc2e58ae3ba749be9"
server_key_version: "encryptionkey@0"
I20260811 11:45:12.946432 24491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:12.972649 24491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:12.976197 24491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:12.976361 24491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:12.976905 24491 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:12.977698 24491 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:12.977746 24491 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:12.977787 24491 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:12.977802 24491 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:12.987300 24491 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:34051
I20260811 11:45:12.987396 24653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:34051 every 8 connection(s)
I20260811 11:45:12.988266 24491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:45:12.991288 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 24491
I20260811 11:45:12.991405 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:45:12.991675 21457 external_mini_cluster.cc:1428] Setting key 19b8aa70df7fd4c17d8b956d928da208
Aug 11 11:45:12 dist-test-slave-vkjp krb5kdc[24365](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448712, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.244.66@KRBTEST.COM; defaulting to no policy
I20260811 11:45:13.004951 24465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:12.990296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:46641 (local address 127.20.244.126:42801)
0811 11:45:12.990469 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:12.990474 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:12.991244 (+ 770us) server_negotiation.cc:407] Connection header received
0811 11:45:12.992890 (+ 1646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:12.992892 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:12.992959 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:12.993044 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:12.994406 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:12.995299 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:12.997387 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:12.997844 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:12.997991 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:13.000784 (+ 2793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:13.000789 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:13.000792 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:13.000826 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:13.002649 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:13.003250 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:13.003255 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:13.003258 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:13.003367 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:13.003766 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:13.003769 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:13.003770 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:13.003976 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:13.004057 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:13.004691 (+ 634us) server_negotiation.cc:299] Negotiation successful
0811 11:45:13.004805 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 11:45:13.005925 24656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:12.990551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:42801 (local address 127.20.244.65:46641)
0811 11:45:12.991021 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:12.991064 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:12.992651 (+ 1587us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:12.993263 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:12.993272 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:12.993752 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:12.994238 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:12.994252 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:12.995484 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:12.995490 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:12.997163 (+ 1673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:12.997175 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:12.998031 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:12.998035 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:12.998190 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:12.998892 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:12.998909 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:13.000596 (+ 1687us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:13.002796 (+ 2200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:13.002801 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:13.002818 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:13.003137 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:13.003488 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:13.003491 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:13.003492 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:13.003646 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:13.004072 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:13.004077 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:13.004364 (+ 287us) client_negotiation.cc:769] Sending connection context
0811 11:45:13.004615 (+ 251us) client_negotiation.cc:240] Negotiation successful
0811 11:45:13.004975 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":115,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.66@KRBTEST.COM" created.
I20260811 11:45:13.007266 24654 heartbeater.cc:347] Connected to a master server at 127.20.244.126:42801
I20260811 11:45:13.007539 24654 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:13.008036 24654 heartbeater.cc:511] Master 127.20.244.126:42801 requested a full tablet report, sending...
I20260811 11:45:13.009501 24419 ts_manager.cc:194] Registered new tserver with Master: ce818ff0b9d748b7a5f0e93066c2b019 (127.20.244.65:34051)
I20260811 11:45:13.010632 24419 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:46641
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
I20260811 11:45:13.022663 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:42801
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:44591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:13.137964 24660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:13.138396 24660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:13.138505 24660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:13.145493 24660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:13.145586 24660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:13.145732 24660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:45:13.152415 24660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:44591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:42801
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:13.153527 24660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:13.154563 24660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:13.164152 24670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:13.164147 24674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:13.164177 24668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:13.164345 24660 server_base.cc:1034] running on GCE node
I20260811 11:45:13.164794 24660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:13.165422 24660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:13.166587 24660 hybrid_clock.cc:648] HybridClock initialized: now 1786448713166576 us; error 25 us; skew 500 ppm
Aug 11 11:45:13 dist-test-slave-vkjp krb5kdc[24365](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448713, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:13.169396 24660 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:45:13.170202 24660 webserver.cc:460] Webserver started at http://127.20.244.66:42921/ using document root <none> and password file <none>
I20260811 11:45:13.170713 24660 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:13.170769 24660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:13.170933 24660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:13.173038 24660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "1407d203b94d44139f5cc96533579284"
format_stamp: "Formatted at 2026-08-11 11:45:13 on dist-test-slave-vkjp"
server_key: "be0fe5366905b87fcbd29e3517ed8d61"
server_key_iv: "413a7976259420a8757c5cb8f81d88ce"
server_key_version: "encryptionkey@0"
I20260811 11:45:13.173563 24660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "1407d203b94d44139f5cc96533579284"
format_stamp: "Formatted at 2026-08-11 11:45:13 on dist-test-slave-vkjp"
server_key: "be0fe5366905b87fcbd29e3517ed8d61"
server_key_iv: "413a7976259420a8757c5cb8f81d88ce"
server_key_version: "encryptionkey@0"
I20260811 11:45:13.177316 24660 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 11:45:13.179808 24682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:13.181223 24660 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 11:45:13.181326 24660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "1407d203b94d44139f5cc96533579284"
format_stamp: "Formatted at 2026-08-11 11:45:13 on dist-test-slave-vkjp"
server_key: "be0fe5366905b87fcbd29e3517ed8d61"
server_key_iv: "413a7976259420a8757c5cb8f81d88ce"
server_key_version: "encryptionkey@0"
I20260811 11:45:13.181418 24660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:13.209149 24660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:13.212693 24660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:13.212868 24660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:13.213430 24660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:13.214252 24660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:13.214301 24660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:13.214344 24660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:13.214360 24660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:13.224155 24660 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:39725
I20260811 11:45:13.224180 24818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:39725 every 8 connection(s)
I20260811 11:45:13.225104 24660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:45:13.229918 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 24660
I20260811 11:45:13.230010 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:45:13.230279 21457 external_mini_cluster.cc:1428] Setting key 9425cf1c432f9255e1f8b41f3dc7a74b
Aug 11 11:45:13 dist-test-slave-vkjp krb5kdc[24365](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448713, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:13.241580 24465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:13.227072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:57937 (local address 127.20.244.126:42801)
0811 11:45:13.227289 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:13.227295 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:13.228706 (+ 1411us) server_negotiation.cc:407] Connection header received
0811 11:45:13.230172 (+ 1466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:13.230176 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:13.230236 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:13.230365 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:13.231754 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:13.232509 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:13.233666 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:13.234014 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:13.234103 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:13.237131 (+ 3028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:13.237138 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:13.237143 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:13.237182 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:13.239014 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:13.239749 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:13.239752 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:13.239753 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:13.239840 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:13.240281 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:13.240283 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:13.240284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:13.240509 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:13.240592 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:13.241338 (+ 746us) server_negotiation.cc:299] Negotiation successful
0811 11:45:13.241454 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
WARNING: no policy specified for kudu/127.20.244.67@KRBTEST.COM; defaulting to no policy
I20260811 11:45:13.242728 24823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:13.227880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:42801 (local address 127.20.244.66:57937)
0811 11:45:13.228511 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:13.228583 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:13.229870 (+ 1287us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:13.230536 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:13.230543 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:13.231004 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:13.231559 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:13.231574 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:13.232648 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:13.232651 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:13.233538 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:13.233548 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:13.234173 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:13.234179 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:13.234476 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:13.235161 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:13.235185 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:13.236889 (+ 1704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:13.239218 (+ 2329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:13.239226 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:13.239247 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:13.239626 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:13.239946 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:13.239952 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:13.239954 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:13.240153 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:13.240627 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:13.240635 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:13.241010 (+ 375us) client_negotiation.cc:769] Sending connection context
0811 11:45:13.241258 (+ 248us) client_negotiation.cc:240] Negotiation successful
0811 11:45:13.241709 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":119,"threads_started":1}
I20260811 11:45:13.244519 24820 heartbeater.cc:347] Connected to a master server at 127.20.244.126:42801
I20260811 11:45:13.244798 24820 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.67@KRBTEST.COM" created.
I20260811 11:45:13.245375 24820 heartbeater.cc:511] Master 127.20.244.126:42801 requested a full tablet report, sending...
I20260811 11:45:13.246682 24419 ts_manager.cc:194] Registered new tserver with Master: 1407d203b94d44139f5cc96533579284 (127.20.244.66:39725)
I20260811 11:45:13.247366 24419 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:57937
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
I20260811 11:45:13.262940 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:42801
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:44591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:13.383097 24826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:13.383389 24826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:13.383462 24826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:13.387475 24826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:13.387552 24826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:13.387642 24826 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:45:13.392738 24826 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:44591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:42801
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:13.393734 24826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:13.394786 24826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:13.404321 24836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:13.404294 24834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:13.404294 24833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:13.404547 24826 server_base.cc:1034] running on GCE node
I20260811 11:45:13.405040 24826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:13.405741 24826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:13.406930 24826 hybrid_clock.cc:648] HybridClock initialized: now 1786448713406920 us; error 29 us; skew 500 ppm
Aug 11 11:45:13 dist-test-slave-vkjp krb5kdc[24365](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448713, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:13.409699 24826 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:45:13.410550 24826 webserver.cc:460] Webserver started at http://127.20.244.67:40491/ using document root <none> and password file <none>
I20260811 11:45:13.411166 24826 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:13.411231 24826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:13.411463 24826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:13.413462 24826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "bbea8805f67644129937811eef73ad68"
format_stamp: "Formatted at 2026-08-11 11:45:13 on dist-test-slave-vkjp"
server_key: "892cdee3220ab31dc76953fbd5315c9a"
server_key_iv: "dc8df3bb28dad8ad73f7687609fdd7d6"
server_key_version: "encryptionkey@0"
I20260811 11:45:13.414040 24826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "bbea8805f67644129937811eef73ad68"
format_stamp: "Formatted at 2026-08-11 11:45:13 on dist-test-slave-vkjp"
server_key: "892cdee3220ab31dc76953fbd5315c9a"
server_key_iv: "dc8df3bb28dad8ad73f7687609fdd7d6"
server_key_version: "encryptionkey@0"
I20260811 11:45:13.417652 24826 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 11:45:13.420025 24844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:13.421245 24826 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:45:13.421367 24826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "bbea8805f67644129937811eef73ad68"
format_stamp: "Formatted at 2026-08-11 11:45:13 on dist-test-slave-vkjp"
server_key: "892cdee3220ab31dc76953fbd5315c9a"
server_key_iv: "dc8df3bb28dad8ad73f7687609fdd7d6"
server_key_version: "encryptionkey@0"
I20260811 11:45:13.421468 24826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:13.437012 24826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:13.440274 24826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:13.440469 24826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:13.441064 24826 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:13.441875 24826 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:13.441921 24826 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:13.441989 24826 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:13.442026 24826 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:13.451196 24826 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:37935
I20260811 11:45:13.451207 24990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:37935 every 8 connection(s)
I20260811 11:45:13.452126 24826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:45:13.460422 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 24826
I20260811 11:45:13.460531 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:45:13.460850 21457 external_mini_cluster.cc:1428] Setting key a306f4c908209937ed4379d1ff1b76b0
Aug 11 11:45:13 dist-test-slave-vkjp krb5kdc[24365](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448713, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:13.466195 24465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:13.454051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:38661 (local address 127.20.244.126:42801)
0811 11:45:13.454195 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:13.454198 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:13.454977 (+ 779us) server_negotiation.cc:407] Connection header received
0811 11:45:13.456249 (+ 1272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:13.456252 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:13.456302 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:13.456413 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:13.457624 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:13.458155 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:13.459340 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:13.459557 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:13.459648 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:13.462620 (+ 2972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:13.462624 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:13.462626 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:13.462655 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:13.464211 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:13.464708 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:13.464711 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:13.464712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:13.464792 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:13.465168 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:13.465171 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:13.465172 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:13.465352 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:13.465439 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:13.465967 (+ 528us) server_negotiation.cc:299] Negotiation successful
0811 11:45:13.466068 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 11:45:13.467181 24994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:13.454361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:42801 (local address 127.20.244.67:38661)
0811 11:45:13.454814 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:13.454857 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:13.456044 (+ 1187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:13.456594 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:13.456601 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:13.456953 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:13.457431 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:13.457444 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:13.458286 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:13.458289 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:13.459201 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:13.459210 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:13.459708 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:13.459710 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:13.459850 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:13.460509 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:13.460537 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:13.462455 (+ 1918us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:13.464329 (+ 1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:13.464336 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:13.464353 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:13.464616 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:13.464909 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:13.464911 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:13.464913 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:13.465079 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:13.465472 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:13.465478 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:13.465730 (+ 252us) client_negotiation.cc:769] Sending connection context
0811 11:45:13.465943 (+ 213us) client_negotiation.cc:240] Negotiation successful
0811 11:45:13.466214 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":114,"threads_started":1}
I20260811 11:45:13.468364 24992 heartbeater.cc:347] Connected to a master server at 127.20.244.126:42801
I20260811 11:45:13.468621 24992 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:13.469133 24992 heartbeater.cc:511] Master 127.20.244.126:42801 requested a full tablet report, sending...
I20260811 11:45:13.470146 24419 ts_manager.cc:194] Registered new tserver with Master: bbea8805f67644129937811eef73ad68 (127.20.244.67:37935)
I20260811 11:45:13.470729 24419 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:38661
I20260811 11:45:13.475690 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 11:45:13.492398 24465 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:13.490924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50220 (local address 127.20.244.126:42801)
0811 11:45:13.491061 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:13.491064 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:13.491252 (+ 188us) server_negotiation.cc:407] Connection header received
0811 11:45:13.491370 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:13.491373 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:13.491419 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:13.491504 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:13.492226 (+ 722us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50220: BlockingRecv error: recv got EOF from 127.0.0.1:50220 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 11:45:13.493640 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 24491
I20260811 11:45:13.507987 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 24660
I20260811 11:45:13.524197 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 24826
I20260811 11:45:13.532688 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 24379
2026-08-11T11:45:13Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2384 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:45:13 dist-test-slave-vkjp krb5kdc[25007](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:45:13 dist-test-slave-vkjp krb5kdc[25007](info): set up 2 sockets
Aug 11 11:45:13 dist-test-slave-vkjp krb5kdc[25007](info): commencing operation
krb5kdc: starting...
W20260811 11:45:14.782778 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260811 11:45:14.997335 21457 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.214s user 0.000s sys 0.002s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260811 11:45:15.197543 21457 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.200s user 0.000s sys 0.002s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260811 11:45:15.496917 21457 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.299s user 0.000s sys 0.002s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/krb5kdc/test-user.keytab.
W20260811 11:45:15.614177 21457 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.117s user 0.000s sys 0.002s
Aug 11 11:45:15 dist-test-slave-vkjp krb5kdc[25007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:45:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:45:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:45:15.662865 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:39391
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:37033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:39391
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:15.778120 25025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:15.778437 25025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:15.778523 25025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:15.782663 25025 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:15.782763 25025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:15.782801 25025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:15.782860 25025 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:15.782899 25025 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:45:15.788357 25025 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:39391
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:39391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25025
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:15.789513 25025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:15.790587 25025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:15.799304 25033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:15.799274 25030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:15.799351 25031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:15.799911 25025 server_base.cc:1034] running on GCE node
I20260811 11:45:15.800474 25025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:15.801551 25025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:15.802716 25025 hybrid_clock.cc:648] HybridClock initialized: now 1786448715802688 us; error 43 us; skew 500 ppm
Aug 11 11:45:15 dist-test-slave-vkjp krb5kdc[25007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448715, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:15.816617 25025 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:45:15.817597 25025 webserver.cc:460] Webserver started at http://127.20.244.126:36889/ using document root <none> and password file <none>
I20260811 11:45:15.818140 25025 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:15.818209 25025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:15.818395 25025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:15.820565 25025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "5198e100c9ac4d35a06c3d1d4a00a811"
format_stamp: "Formatted at 2026-08-11 11:45:15 on dist-test-slave-vkjp"
server_key: "714af8331b4e75b4ebffc64a2e85f3fb"
server_key_iv: "84b57fbd91930b06e464027cbddd5874"
server_key_version: "encryptionkey@0"
I20260811 11:45:15.821105 25025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "5198e100c9ac4d35a06c3d1d4a00a811"
format_stamp: "Formatted at 2026-08-11 11:45:15 on dist-test-slave-vkjp"
server_key: "714af8331b4e75b4ebffc64a2e85f3fb"
server_key_iv: "84b57fbd91930b06e464027cbddd5874"
server_key_version: "encryptionkey@0"
I20260811 11:45:15.824983 25025 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 11:45:15.827778 25042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:15.828995 25025 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:45:15.829108 25025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "5198e100c9ac4d35a06c3d1d4a00a811"
format_stamp: "Formatted at 2026-08-11 11:45:15 on dist-test-slave-vkjp"
server_key: "714af8331b4e75b4ebffc64a2e85f3fb"
server_key_iv: "84b57fbd91930b06e464027cbddd5874"
server_key_version: "encryptionkey@0"
I20260811 11:45:15.829192 25025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:15.845852 25025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:15.848693 25025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:15.848860 25025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:15.856387 25025 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:39391
I20260811 11:45:15.856731 25107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:39391 every 8 connection(s)
I20260811 11:45:15.857375 25025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:45:15.859905 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 25025
I20260811 11:45:15.860009 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:45:15.860312 25108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:15.860332 21457 external_mini_cluster.cc:1428] Setting key 5b60d21931645f9ec1d5ec6004afd9d1
I20260811 11:45:15.867658 25108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811: Bootstrap starting.
Aug 11 11:45:15 dist-test-slave-vkjp krb5kdc[25007](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:15.870123 25108 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:15.871043 25108 log.cc:824] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:15.873502 25108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811: No bootstrap required, opened a new log
I20260811 11:45:15.875844 25111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:15.861729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46166 (local address 127.20.244.126:39391)
0811 11:45:15.862170 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:15.862191 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:15.862236 (+ 45us) server_negotiation.cc:407] Connection header received
0811 11:45:15.863195 (+ 959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:15.863221 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:15.863649 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:15.864023 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:15.864721 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:15.866207 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:15.867134 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:15.867817 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:15.867971 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:15.870544 (+ 2573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:15.870551 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:15.870566 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:15.870600 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:15.872648 (+ 2048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:15.873087 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:15.873093 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:15.873099 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:15.873247 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:15.873532 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:15.873537 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:15.873541 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:15.874043 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:15.874224 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:15.874492 (+ 268us) server_negotiation.cc:299] Negotiation successful
0811 11:45:15.874780 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":125,"threads_started":1}
I20260811 11:45:15.877970 25108 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5198e100c9ac4d35a06c3d1d4a00a811" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39391 } }
I20260811 11:45:15.878248 25108 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:15.878332 25108 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5198e100c9ac4d35a06c3d1d4a00a811, State: Initialized, Role: FOLLOWER
I20260811 11:45:15.878794 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:45:15.878796 25108 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5198e100c9ac4d35a06c3d1d4a00a811" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39391 } }
I20260811 11:45:15.878985 25108 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:45:15.879072 25108 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:45:15.879195 25108 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:15.880080 25108 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5198e100c9ac4d35a06c3d1d4a00a811" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39391 } }
I20260811 11:45:15.880414 25108 leader_election.cc:302] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5198e100c9ac4d35a06c3d1d4a00a811; no voters:
I20260811 11:45:15.880721 25108 leader_election.cc:288] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:45:15.880844 25115 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:15.881116 25115 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811 [term 1 LEADER]: Becoming Leader. State: Replica: 5198e100c9ac4d35a06c3d1d4a00a811, State: Running, Role: LEADER
I20260811 11:45:15.881520 25115 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5198e100c9ac4d35a06c3d1d4a00a811" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39391 } }
I20260811 11:45:15.882027 25108 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:45:15.882736 25115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5198e100c9ac4d35a06c3d1d4a00a811. Latest consensus state: current_term: 1 leader_uuid: "5198e100c9ac4d35a06c3d1d4a00a811" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5198e100c9ac4d35a06c3d1d4a00a811" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39391 } } }
I20260811 11:45:15.883351 25117 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5198e100c9ac4d35a06c3d1d4a00a811" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5198e100c9ac4d35a06c3d1d4a00a811" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39391 } } }
I20260811 11:45:15.883555 25117 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:15.883993 25131 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:45:15.883482 25115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:15.887444 25131 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:45:15.893673 25131 catalog_manager.cc:1347] Generated new cluster ID: 58aaf46dc8234647b8bcfe33d270b76c
I20260811 11:45:15.893793 25131 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:45:15.900831 25111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:15.895288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46178 (local address 127.20.244.126:39391)
0811 11:45:15.895413 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:15.895418 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:15.895642 (+ 224us) server_negotiation.cc:407] Connection header received
0811 11:45:15.895752 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:15.895756 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:15.895808 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:15.895913 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:15.896475 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:15.897306 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:15.898438 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:15.898797 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:15.898911 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:15.899835 (+ 924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:15.899840 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:15.899843 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:15.900395 (+ 552us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:15.900432 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:15.900451 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:15.900544 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:15.900627 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 11:45:15.900689 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 11:45:15.904258 25131 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:45:15.905432 25131 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:45:15.917707 25131 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5198e100c9ac4d35a06c3d1d4a00a811: Generated new TSK 0
I20260811 11:45:15.918506 25131 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:45:15.932688 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 25025
2026-08-11T11:45:15Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2398 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:45:15 dist-test-slave-vkjp krb5kdc[25147](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:45:15 dist-test-slave-vkjp krb5kdc[25147](info): set up 2 sockets
Aug 11 11:45:15 dist-test-slave-vkjp krb5kdc[25147](info): commencing operation
krb5kdc: starting...
W20260811 11:45:17.068473 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:45:17 dist-test-slave-vkjp krb5kdc[25147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448717, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:45:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:45:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:45:17.198021 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:40133
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:34007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:40133
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:17.309242 25166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:17.309545 25166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:17.309626 25166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:17.313571 25166 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:17.313655 25166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:17.313694 25166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:17.313752 25166 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:17.313789 25166 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:45:17.318845 25166 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:34007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:40133
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:40133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:17.319862 25166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:17.320906 25166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:17.329324 25171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:17.329401 25172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:17.329389 25174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:17.329598 25166 server_base.cc:1034] running on GCE node
I20260811 11:45:17.330229 25166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:17.331377 25166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:17.332567 25166 hybrid_clock.cc:648] HybridClock initialized: now 1786448717332527 us; error 52 us; skew 500 ppm
Aug 11 11:45:17 dist-test-slave-vkjp krb5kdc[25147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448717, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:17.335330 25166 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:45:17.336501 25166 webserver.cc:460] Webserver started at http://127.20.244.126:38849/ using document root <none> and password file <none>
I20260811 11:45:17.337056 25166 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:17.337158 25166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:17.337380 25166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:17.339468 25166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "e5e391a59cfc47b3a7bfc0754927a72a"
format_stamp: "Formatted at 2026-08-11 11:45:17 on dist-test-slave-vkjp"
server_key: "322ae498cec41795fe8c157f3d67da84"
server_key_iv: "7f6d98a414fefd5a3857f4fb699efd1e"
server_key_version: "encryptionkey@0"
I20260811 11:45:17.340034 25166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "e5e391a59cfc47b3a7bfc0754927a72a"
format_stamp: "Formatted at 2026-08-11 11:45:17 on dist-test-slave-vkjp"
server_key: "322ae498cec41795fe8c157f3d67da84"
server_key_iv: "7f6d98a414fefd5a3857f4fb699efd1e"
server_key_version: "encryptionkey@0"
I20260811 11:45:17.343961 25166 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 11:45:17.346410 25182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:17.347772 25166 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:45:17.347925 25166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "e5e391a59cfc47b3a7bfc0754927a72a"
format_stamp: "Formatted at 2026-08-11 11:45:17 on dist-test-slave-vkjp"
server_key: "322ae498cec41795fe8c157f3d67da84"
server_key_iv: "7f6d98a414fefd5a3857f4fb699efd1e"
server_key_version: "encryptionkey@0"
I20260811 11:45:17.348042 25166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:17.360291 25166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:17.363018 25166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:17.363245 25166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:17.370816 25166 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:40133
I20260811 11:45:17.371125 25247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:40133 every 8 connection(s)
I20260811 11:45:17.371960 25166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:45:17.374040 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 25166
I20260811 11:45:17.374202 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:45:17.374574 21457 external_mini_cluster.cc:1428] Setting key 1800ceb2e4ee3dbfd4a63f55174df0ae
I20260811 11:45:17.374910 25248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:17.382210 25248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a: Bootstrap starting.
Aug 11 11:45:17 dist-test-slave-vkjp krb5kdc[25147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448717, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:17.384799 25248 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:17.385712 25248 log.cc:824] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:17.387861 25248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a: No bootstrap required, opened a new log
I20260811 11:45:17.390036 25251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:17.376173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38044 (local address 127.20.244.126:40133)
0811 11:45:17.376617 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:17.376635 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:17.376675 (+ 40us) server_negotiation.cc:407] Connection header received
0811 11:45:17.377646 (+ 971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:17.377670 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:17.378085 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:17.378489 (+ 404us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:17.379285 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:17.380791 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:17.381684 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:17.382360 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:17.382532 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:17.385306 (+ 2774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:17.385311 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:17.385323 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:17.385351 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:17.387204 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:17.387711 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:17.387715 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:17.387720 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:17.387855 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:17.388162 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:17.388164 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:17.388166 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:17.388540 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:17.388690 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:17.389002 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 11:45:17.389301 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":107,"threads_started":1}
I20260811 11:45:17.391709 25248 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e391a59cfc47b3a7bfc0754927a72a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40133 } }
I20260811 11:45:17.391970 25248 raft_consensus.cc:374] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:17.392059 25248 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5e391a59cfc47b3a7bfc0754927a72a, State: Initialized, Role: FOLLOWER
I20260811 11:45:17.392470 25248 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e391a59cfc47b3a7bfc0754927a72a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40133 } }
I20260811 11:45:17.392596 25248 raft_consensus.cc:388] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:45:17.392719 25248 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:45:17.392843 25248 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:17.393724 25248 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e391a59cfc47b3a7bfc0754927a72a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40133 } }
I20260811 11:45:17.394094 25248 leader_election.cc:302] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e5e391a59cfc47b3a7bfc0754927a72a; no voters:
I20260811 11:45:17.394395 25248 leader_election.cc:288] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:45:17.394572 25253 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:17.394816 25253 raft_consensus.cc:686] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a [term 1 LEADER]: Becoming Leader. State: Replica: e5e391a59cfc47b3a7bfc0754927a72a, State: Running, Role: LEADER
I20260811 11:45:17.395210 25253 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e391a59cfc47b3a7bfc0754927a72a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40133 } }
I20260811 11:45:17.395682 25248 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:45:17.396920 25254 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e5e391a59cfc47b3a7bfc0754927a72a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e391a59cfc47b3a7bfc0754927a72a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40133 } } }
I20260811 11:45:17.397050 25254 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:17.397362 25255 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5e391a59cfc47b3a7bfc0754927a72a. Latest consensus state: current_term: 1 leader_uuid: "e5e391a59cfc47b3a7bfc0754927a72a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e391a59cfc47b3a7bfc0754927a72a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40133 } } }
I20260811 11:45:17.397477 25263 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:45:17.397539 25255 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:17.400250 25263 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:45:17.405767 25263 catalog_manager.cc:1347] Generated new cluster ID: a18923bb9dd549d9a9c809cbb29ec511
I20260811 11:45:17.405839 25263 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:45:17.420429 25263 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:45:17.421293 25263 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:45:17.428274 25263 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e5e391a59cfc47b3a7bfc0754927a72a: Generated new TSK 0
I20260811 11:45:17.428921 25263 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.244.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
I20260811 11:45:17.460186 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40133
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:34007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:17.573221 25277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:17.573468 25277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:17.573510 25277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:17.577644 25277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:17.577697 25277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:17.577813 25277 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:45:17.582971 25277 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:34007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:17.583976 25277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:17.584955 25277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:17.596717 25282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:17.596876 25277 server_base.cc:1034] running on GCE node
W20260811 11:45:17.596743 25283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:17.597132 25285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:17.597553 25277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:17.598173 25277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:17.599339 25277 hybrid_clock.cc:648] HybridClock initialized: now 1786448717599298 us; error 48 us; skew 500 ppm
Aug 11 11:45:17 dist-test-slave-vkjp krb5kdc[25147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448717, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:17.602123 25277 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:45:17.603018 25277 webserver.cc:460] Webserver started at http://127.20.244.65:42993/ using document root <none> and password file <none>
I20260811 11:45:17.603598 25277 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:17.603660 25277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:17.603938 25277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:17.605948 25277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "023a5f31531a41a3824cecf15007d87b"
format_stamp: "Formatted at 2026-08-11 11:45:17 on dist-test-slave-vkjp"
server_key: "80b27d61107ec2ee11483a863b35ebcb"
server_key_iv: "7b52f6265b88cdcb4544a84787009c78"
server_key_version: "encryptionkey@0"
I20260811 11:45:17.606576 25277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "023a5f31531a41a3824cecf15007d87b"
format_stamp: "Formatted at 2026-08-11 11:45:17 on dist-test-slave-vkjp"
server_key: "80b27d61107ec2ee11483a863b35ebcb"
server_key_iv: "7b52f6265b88cdcb4544a84787009c78"
server_key_version: "encryptionkey@0"
I20260811 11:45:17.610323 25277 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 11:45:17.612756 25293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:17.614059 25277 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 11:45:17.614228 25277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "023a5f31531a41a3824cecf15007d87b"
format_stamp: "Formatted at 2026-08-11 11:45:17 on dist-test-slave-vkjp"
server_key: "80b27d61107ec2ee11483a863b35ebcb"
server_key_iv: "7b52f6265b88cdcb4544a84787009c78"
server_key_version: "encryptionkey@0"
I20260811 11:45:17.614326 25277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:17.624531 25277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:17.627836 25277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:17.628046 25277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:17.628635 25277 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:17.629449 25277 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:17.629523 25277 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:17.629595 25277 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:17.629642 25277 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:17.638922 25277 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:44259
I20260811 11:45:17.638955 25429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:44259 every 8 connection(s)
I20260811 11:45:17.639912 25277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:45:17.646847 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 25277
I20260811 11:45:17.647001 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:45:17.647325 21457 external_mini_cluster.cc:1428] Setting key aa98574b3a54e8c43b6210ac111fc1e1
Aug 11 11:45:17 dist-test-slave-vkjp krb5kdc[25147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448717, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:17.654701 25251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:17.641666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:48019 (local address 127.20.244.126:40133)
0811 11:45:17.641808 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:17.641813 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:17.642669 (+ 856us) server_negotiation.cc:407] Connection header received
0811 11:45:17.644136 (+ 1467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:17.644139 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:17.644192 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:17.644278 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:17.645433 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:17.645971 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:17.647516 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:17.647754 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:17.647839 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:17.650746 (+ 2907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:17.650753 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:17.650759 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:17.650794 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:17.652397 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:17.653040 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:17.653042 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:17.653043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:17.653119 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:17.653514 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:17.653517 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:17.653518 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:17.653690 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:17.653766 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:17.654478 (+ 712us) server_negotiation.cc:299] Negotiation successful
0811 11:45:17.654579 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 11:45:17.656091 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:17.642056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40133 (local address 127.20.244.65:48019)
0811 11:45:17.642503 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:17.642547 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:17.643911 (+ 1364us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:17.644443 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:17.644449 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:17.644816 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:17.645284 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:17.645296 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:17.646094 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:17.646097 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:17.647358 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:17.647372 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:17.647930 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:17.647938 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:17.648121 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:17.648806 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:17.648826 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:17.650565 (+ 1739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:17.652520 (+ 1955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:17.652529 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:17.652548 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:17.652933 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:17.653209 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:17.653215 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:17.653220 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:17.653418 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:17.653801 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:17.653811 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:17.654191 (+ 380us) client_negotiation.cc:769] Sending connection context
0811 11:45:17.654434 (+ 243us) client_negotiation.cc:240] Negotiation successful
0811 11:45:17.654811 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":117,"threads_started":1}
I20260811 11:45:17.657509 25430 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40133
I20260811 11:45:17.657774 25430 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:17.658315 25430 heartbeater.cc:511] Master 127.20.244.126:40133 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.20.244.66@KRBTEST.COM; defaulting to no policy
I20260811 11:45:17.659960 25202 ts_manager.cc:194] Registered new tserver with Master: 023a5f31531a41a3824cecf15007d87b (127.20.244.65:44259)
I20260811 11:45:17.661267 25202 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:48019
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
I20260811 11:45:17.678274 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40133
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:34007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:17.791917 25438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:17.792168 25438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:17.792212 25438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:17.796458 25438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:17.796535 25438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:17.796648 25438 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:45:17.801847 25438 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:34007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25438
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:17.802809 25438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:17.803853 25438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:17.813848 25447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:17.813850 25450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:17.813832 25446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:17.814194 25438 server_base.cc:1034] running on GCE node
I20260811 11:45:17.814752 25438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:17.815488 25438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:17.816658 25438 hybrid_clock.cc:648] HybridClock initialized: now 1786448717816640 us; error 26 us; skew 500 ppm
Aug 11 11:45:17 dist-test-slave-vkjp krb5kdc[25147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448717, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:17.819614 25438 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:45:17.820513 25438 webserver.cc:460] Webserver started at http://127.20.244.66:42897/ using document root <none> and password file <none>
I20260811 11:45:17.821079 25438 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:17.821143 25438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:17.821360 25438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:17.823474 25438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "e6c3575e1227417692786935f8272744"
format_stamp: "Formatted at 2026-08-11 11:45:17 on dist-test-slave-vkjp"
server_key: "b54c9584cb5654f1660252baed2f31ea"
server_key_iv: "186faf9aa717860ce35843034a2dd027"
server_key_version: "encryptionkey@0"
I20260811 11:45:17.824052 25438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "e6c3575e1227417692786935f8272744"
format_stamp: "Formatted at 2026-08-11 11:45:17 on dist-test-slave-vkjp"
server_key: "b54c9584cb5654f1660252baed2f31ea"
server_key_iv: "186faf9aa717860ce35843034a2dd027"
server_key_version: "encryptionkey@0"
I20260811 11:45:17.827821 25438 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:45:17.830191 25458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:17.831480 25438 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:45:17.831625 25438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "e6c3575e1227417692786935f8272744"
format_stamp: "Formatted at 2026-08-11 11:45:17 on dist-test-slave-vkjp"
server_key: "b54c9584cb5654f1660252baed2f31ea"
server_key_iv: "186faf9aa717860ce35843034a2dd027"
server_key_version: "encryptionkey@0"
I20260811 11:45:17.831743 25438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:17.845479 25438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:17.848881 25438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:17.849087 25438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:17.849678 25438 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:17.850502 25438 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:17.850571 25438 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:17.850644 25438 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:17.850695 25438 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:17.860356 25438 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:44929
I20260811 11:45:17.860399 25599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:44929 every 8 connection(s)
I20260811 11:45:17.861303 25438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:45:17.865657 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 25438
I20260811 11:45:17.865866 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:45:17.866207 21457 external_mini_cluster.cc:1428] Setting key 9f66bfaee17c7edb4c287890c7051bc0
Aug 11 11:45:17 dist-test-slave-vkjp krb5kdc[25147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448717, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:17.876959 25251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:17.863219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:33891 (local address 127.20.244.126:40133)
0811 11:45:17.863397 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:17.863400 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:17.864191 (+ 791us) server_negotiation.cc:407] Connection header received
0811 11:45:17.865670 (+ 1479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:17.865673 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:17.865721 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:17.865831 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:17.867336 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:17.867951 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:17.869695 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:17.870024 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:17.870137 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:17.872956 (+ 2819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:17.872963 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:17.872969 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:17.873007 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:17.874567 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:17.875291 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:17.875293 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:17.875295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:17.875373 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:17.875777 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:17.875780 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:17.875781 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:17.875969 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:17.876044 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:17.876730 (+ 686us) server_negotiation.cc:299] Negotiation successful
0811 11:45:17.876836 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
WARNING: no policy specified for kudu/127.20.244.67@KRBTEST.COM; defaulting to no policy
I20260811 11:45:17.878269 25602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:17.863590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40133 (local address 127.20.244.66:33891)
0811 11:45:17.864042 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:17.864084 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:17.865425 (+ 1341us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:17.866047 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:17.866058 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:17.866579 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:17.867173 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:17.867193 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:17.868081 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:17.868084 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:17.869561 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:17.869576 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:17.870177 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:17.870180 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:17.870339 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:17.870956 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:17.870972 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:17.872753 (+ 1781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:17.874699 (+ 1946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:17.874708 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:17.874729 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:17.875179 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:17.875470 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:17.875474 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:17.875476 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:17.875670 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:17.876085 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:17.876094 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:17.876450 (+ 356us) client_negotiation.cc:769] Sending connection context
0811 11:45:17.876680 (+ 230us) client_negotiation.cc:240] Negotiation successful
0811 11:45:17.877063 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":118,"threads_started":1}
I20260811 11:45:17.879621 25600 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40133
I20260811 11:45:17.879876 25600 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:17.880448 25600 heartbeater.cc:511] Master 127.20.244.126:40133 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.67@KRBTEST.COM" created.
I20260811 11:45:17.881726 25202 ts_manager.cc:194] Registered new tserver with Master: e6c3575e1227417692786935f8272744 (127.20.244.66:44929)
I20260811 11:45:17.882589 25202 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:33891
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
I20260811 11:45:17.898351 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40133
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:34007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:18.011440 25605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:18.011703 25605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:18.011747 25605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:18.015866 25605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:18.015950 25605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:18.016010 25605 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:45:18.022023 25605 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:34007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25605
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:18.023170 25605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:18.024225 25605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:18.034101 25614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:18.034245 25613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:18.034222 25616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:18.034467 25605 server_base.cc:1034] running on GCE node
I20260811 11:45:18.034860 25605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:18.035566 25605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:18.036769 25605 hybrid_clock.cc:648] HybridClock initialized: now 1786448718036747 us; error 33 us; skew 500 ppm
Aug 11 11:45:18 dist-test-slave-vkjp krb5kdc[25147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448718, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:18.039721 25605 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:45:18.040660 25605 webserver.cc:460] Webserver started at http://127.20.244.67:37535/ using document root <none> and password file <none>
I20260811 11:45:18.041275 25605 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:18.041370 25605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:18.041631 25605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:18.043766 25605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "c30cede6a8a24b3680b3a8c5120e0cdc"
format_stamp: "Formatted at 2026-08-11 11:45:18 on dist-test-slave-vkjp"
server_key: "3be2c1bd4d3eddaf73c64a699b657589"
server_key_iv: "9a5aa93e0741a65212ab2b734284c8af"
server_key_version: "encryptionkey@0"
I20260811 11:45:18.044351 25605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "c30cede6a8a24b3680b3a8c5120e0cdc"
format_stamp: "Formatted at 2026-08-11 11:45:18 on dist-test-slave-vkjp"
server_key: "3be2c1bd4d3eddaf73c64a699b657589"
server_key_iv: "9a5aa93e0741a65212ab2b734284c8af"
server_key_version: "encryptionkey@0"
I20260811 11:45:18.048077 25605 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 11:45:18.050527 25628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:18.051843 25605 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:18.051997 25605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "c30cede6a8a24b3680b3a8c5120e0cdc"
format_stamp: "Formatted at 2026-08-11 11:45:18 on dist-test-slave-vkjp"
server_key: "3be2c1bd4d3eddaf73c64a699b657589"
server_key_iv: "9a5aa93e0741a65212ab2b734284c8af"
server_key_version: "encryptionkey@0"
I20260811 11:45:18.052114 25605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:18.061759 25605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:18.065130 25605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:18.065344 25605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:18.065955 25605 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:18.066962 25605 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:18.067047 25605 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:18.067137 25605 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:18.067194 25605 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:18.076453 25605 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:37789
I20260811 11:45:18.076483 25765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:37789 every 8 connection(s)
I20260811 11:45:18.077361 25605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:45:18.085197 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 25605
I20260811 11:45:18.085304 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:45:18.085606 21457 external_mini_cluster.cc:1428] Setting key 11c8eb976714f78559ec6043b14f5fa3
Aug 11 11:45:18 dist-test-slave-vkjp krb5kdc[25147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448718, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:18.091137 25251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:18.079151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:59391 (local address 127.20.244.126:40133)
0811 11:45:18.079291 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:18.079295 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:18.080083 (+ 788us) server_negotiation.cc:407] Connection header received
0811 11:45:18.081469 (+ 1386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:18.081472 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:18.081533 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:18.081642 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:18.082784 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:18.083393 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:18.084556 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:18.084780 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:18.084895 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:18.087650 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:18.087654 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:18.087657 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:18.087690 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:18.089014 (+ 1324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:18.089540 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:18.089544 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:18.089546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:18.089638 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:18.090007 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:18.090012 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:18.090014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:18.090206 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:18.090329 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:18.090817 (+ 488us) server_negotiation.cc:299] Negotiation successful
0811 11:45:18.090947 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 11:45:18.091943 25769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:18.079484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40133 (local address 127.20.244.67:59391)
0811 11:45:18.079933 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:18.079976 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:18.081251 (+ 1275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:18.081814 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:18.081821 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:18.082165 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:18.082632 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:18.082645 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:18.083529 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:18.083533 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:18.084411 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:18.084420 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:18.084961 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:18.084966 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:18.085133 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:18.085785 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:18.085802 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:18.087476 (+ 1674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:18.089139 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:18.089146 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:18.089160 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:18.089429 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:18.089744 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:18.089747 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:18.089749 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:18.089906 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:18.090319 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:18.090326 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:18.090577 (+ 251us) client_negotiation.cc:769] Sending connection context
0811 11:45:18.090770 (+ 193us) client_negotiation.cc:240] Negotiation successful
0811 11:45:18.091125 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":105,"threads_started":1}
I20260811 11:45:18.093031 25766 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40133
I20260811 11:45:18.093281 25766 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:18.093776 25766 heartbeater.cc:511] Master 127.20.244.126:40133 requested a full tablet report, sending...
I20260811 11:45:18.094803 25202 ts_manager.cc:194] Registered new tserver with Master: c30cede6a8a24b3680b3a8c5120e0cdc (127.20.244.67:37789)
I20260811 11:45:18.095458 25202 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:59391
I20260811 11:45:18.099512 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 11:45:18 dist-test-slave-vkjp krb5kdc[25147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448718, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 11:45:18 dist-test-slave-vkjp krb5kdc[25147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448718, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:18.126453 25251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:18.117680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38046 (local address 127.20.244.126:40133)
0811 11:45:18.117862 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:18.117883 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:18.118065 (+ 182us) server_negotiation.cc:407] Connection header received
0811 11:45:18.118252 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:18.118261 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:18.118311 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:18.118401 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:18.119196 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:18.119724 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:18.120578 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:18.120801 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:18.120933 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:18.123379 (+ 2446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:18.123382 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:18.123384 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:18.123409 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:18.124859 (+ 1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:18.125236 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:18.125239 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:18.125240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:18.125315 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:18.125555 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:18.125557 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:18.125558 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:18.125767 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:18.125871 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:18.126128 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 11:45:18.126227 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260811 11:45:18.126915 25202 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:38046
I20260811 11:45:18.127776 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 25277
I20260811 11:45:18.136987 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 25438
I20260811 11:45:18.146422 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 25605
I20260811 11:45:18.155362 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 25166
2026-08-11T11:45:18Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2223 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:45:18 dist-test-slave-vkjp krb5kdc[25781](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:45:18 dist-test-slave-vkjp krb5kdc[25781](info): set up 2 sockets
Aug 11 11:45:18 dist-test-slave-vkjp krb5kdc[25781](info): commencing operation
krb5kdc: starting...
W20260811 11:45:19.295871 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:45:19 dist-test-slave-vkjp krb5kdc[25781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:45:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:45:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:45:19.422575 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:34763
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:37057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:34763
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:19.535815 25796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:19.536073 25796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:19.536113 25796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:19.540030 25796 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:19.540082 25796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:19.540102 25796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:19.540117 25796 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:19.540132 25796 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:45:19.545271 25796 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:34763
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:34763
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25796
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:19.546236 25796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:19.547201 25796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:19.555485 25806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:19.555509 25808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:19.555562 25805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:19.555684 25796 server_base.cc:1034] running on GCE node
I20260811 11:45:19.556357 25796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:19.557504 25796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:19.558683 25796 hybrid_clock.cc:648] HybridClock initialized: now 1786448719558665 us; error 30 us; skew 500 ppm
Aug 11 11:45:19 dist-test-slave-vkjp krb5kdc[25781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448719, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:19.561463 25796 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:45:19.562325 25796 webserver.cc:460] Webserver started at http://127.20.244.126:37901/ using document root <none> and password file <none>
I20260811 11:45:19.562881 25796 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:19.562988 25796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:19.563262 25796 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:19.565290 25796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "1f8d42c5b0064e7aaa85fd26d6ea28f7"
format_stamp: "Formatted at 2026-08-11 11:45:19 on dist-test-slave-vkjp"
server_key: "8368b5854063b7da2f2a4d46afbf239e"
server_key_iv: "048ac346deac249e00cc6e5ad7f8950d"
server_key_version: "encryptionkey@0"
I20260811 11:45:19.565858 25796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "1f8d42c5b0064e7aaa85fd26d6ea28f7"
format_stamp: "Formatted at 2026-08-11 11:45:19 on dist-test-slave-vkjp"
server_key: "8368b5854063b7da2f2a4d46afbf239e"
server_key_iv: "048ac346deac249e00cc6e5ad7f8950d"
server_key_version: "encryptionkey@0"
I20260811 11:45:19.569509 25796 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 11:45:19.571835 25815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:19.573022 25796 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:45:19.573166 25796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "1f8d42c5b0064e7aaa85fd26d6ea28f7"
format_stamp: "Formatted at 2026-08-11 11:45:19 on dist-test-slave-vkjp"
server_key: "8368b5854063b7da2f2a4d46afbf239e"
server_key_iv: "048ac346deac249e00cc6e5ad7f8950d"
server_key_version: "encryptionkey@0"
I20260811 11:45:19.573280 25796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:19.596546 25796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:19.600890 25796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:19.601127 25796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:19.608418 25796 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:34763
I20260811 11:45:19.608752 25875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:34763 every 8 connection(s)
I20260811 11:45:19.609455 25796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:45:19.612368 25876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:19.618264 25876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7: Bootstrap starting.
I20260811 11:45:19.619313 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 25796
I20260811 11:45:19.619462 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:45:19.619778 21457 external_mini_cluster.cc:1428] Setting key a9429faf6a499df00500676c859509b4
I20260811 11:45:19.621382 25876 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:19.622148 25876 log.cc:824] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:19.624111 25876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7: No bootstrap required, opened a new log
I20260811 11:45:19.627849 25876 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f8d42c5b0064e7aaa85fd26d6ea28f7" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34763 } }
I20260811 11:45:19.628139 25876 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:19.628213 25876 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f8d42c5b0064e7aaa85fd26d6ea28f7, State: Initialized, Role: FOLLOWER
Aug 11 11:45:19 dist-test-slave-vkjp krb5kdc[25781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:19.628724 25876 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f8d42c5b0064e7aaa85fd26d6ea28f7" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34763 } }
I20260811 11:45:19.628891 25876 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:45:19.628986 25876 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:45:19.629098 25876 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:19.630354 25876 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f8d42c5b0064e7aaa85fd26d6ea28f7" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34763 } }
I20260811 11:45:19.630744 25876 leader_election.cc:302] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f8d42c5b0064e7aaa85fd26d6ea28f7; no voters:
I20260811 11:45:19.631119 25876 leader_election.cc:288] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:45:19.631204 25882 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:19.631424 25882 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7 [term 1 LEADER]: Becoming Leader. State: Replica: 1f8d42c5b0064e7aaa85fd26d6ea28f7, State: Running, Role: LEADER
I20260811 11:45:19.631788 25882 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f8d42c5b0064e7aaa85fd26d6ea28f7" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34763 } }
I20260811 11:45:19.632460 25876 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:45:19.632975 25882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f8d42c5b0064e7aaa85fd26d6ea28f7. Latest consensus state: current_term: 1 leader_uuid: "1f8d42c5b0064e7aaa85fd26d6ea28f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f8d42c5b0064e7aaa85fd26d6ea28f7" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34763 } } }
I20260811 11:45:19.633180 25882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:19.633414 25883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f8d42c5b0064e7aaa85fd26d6ea28f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f8d42c5b0064e7aaa85fd26d6ea28f7" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34763 } } }
I20260811 11:45:19.633599 25883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:19.633661 25889 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:45:19.635608 25880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:19.620982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49504 (local address 127.20.244.126:34763)
0811 11:45:19.621425 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:19.621441 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:19.621496 (+ 55us) server_negotiation.cc:407] Connection header received
0811 11:45:19.622166 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:19.622183 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:19.622557 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:19.622898 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:19.623776 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:19.624836 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:19.625753 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:19.626257 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:19.626453 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:19.629332 (+ 2879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:19.629338 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:19.629351 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:19.629379 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:19.631493 (+ 2114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:19.632024 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:19.632029 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:19.632035 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:19.632177 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:19.632485 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:19.632489 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:19.632491 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:19.633041 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:19.634059 (+ 1018us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:19.634230 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 11:45:19.634569 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":276,"thread_start_us":144,"threads_started":1}
I20260811 11:45:19.637074 25889 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:45:19.642696 25889 catalog_manager.cc:1347] Generated new cluster ID: eeacb2603e11476391b3472b2f1e59c6
I20260811 11:45:19.642829 25889 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:45:19.653842 25889 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:45:19.654812 25889 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:45:19.667316 25889 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f8d42c5b0064e7aaa85fd26d6ea28f7: Generated new TSK 0
I20260811 11:45:19.668040 25889 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.244.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
I20260811 11:45:19.705878 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:34763
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:37057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:19.849776 25910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:19.850044 25910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:19.850086 25910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:19.854127 25910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:19.854179 25910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:19.854235 25910 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:45:19.859472 25910 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:34763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25910
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:19.860549 25910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:19.861603 25910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:19.871263 25918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:19.871325 25910 server_base.cc:1034] running on GCE node
W20260811 11:45:19.871237 25917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:19.871236 25920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:19.871846 25910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:19.872527 25910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:19.873728 25910 hybrid_clock.cc:648] HybridClock initialized: now 1786448719873706 us; error 41 us; skew 500 ppm
Aug 11 11:45:19 dist-test-slave-vkjp krb5kdc[25781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448719, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:19.876621 25910 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:45:19.877562 25910 webserver.cc:460] Webserver started at http://127.20.244.65:42929/ using document root <none> and password file <none>
I20260811 11:45:19.878160 25910 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:19.878258 25910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:19.878506 25910 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:19.880574 25910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "4c77fa1ea6a5452491fdca292b9e68b1"
format_stamp: "Formatted at 2026-08-11 11:45:19 on dist-test-slave-vkjp"
server_key: "34bf2a40ee2d430fd6c5f80848b5988f"
server_key_iv: "573a199d8ce93f0e47b4c972efe5a5ae"
server_key_version: "encryptionkey@0"
I20260811 11:45:19.881150 25910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "4c77fa1ea6a5452491fdca292b9e68b1"
format_stamp: "Formatted at 2026-08-11 11:45:19 on dist-test-slave-vkjp"
server_key: "34bf2a40ee2d430fd6c5f80848b5988f"
server_key_iv: "573a199d8ce93f0e47b4c972efe5a5ae"
server_key_version: "encryptionkey@0"
I20260811 11:45:19.884862 25910 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260811 11:45:19.887333 25928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:19.888486 25910 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:19.888625 25910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "4c77fa1ea6a5452491fdca292b9e68b1"
format_stamp: "Formatted at 2026-08-11 11:45:19 on dist-test-slave-vkjp"
server_key: "34bf2a40ee2d430fd6c5f80848b5988f"
server_key_iv: "573a199d8ce93f0e47b4c972efe5a5ae"
server_key_version: "encryptionkey@0"
I20260811 11:45:19.888738 25910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:19.918684 25910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:19.921726 25910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:19.921958 25910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:19.922575 25910 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:19.923523 25910 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:19.923596 25910 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:19.923669 25910 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:19.923712 25910 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:19.932945 25910 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:43335
I20260811 11:45:19.932977 26064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:43335 every 8 connection(s)
I20260811 11:45:19.933867 25910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:45:19.934146 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 25910
I20260811 11:45:19.934288 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:45:19.934630 21457 external_mini_cluster.cc:1428] Setting key 1e95006ac4076925fcefd222629fb2a5
Aug 11 11:45:19 dist-test-slave-vkjp krb5kdc[25781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448719, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.244.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.66@KRBTEST.COM" created.
I20260811 11:45:19.949172 25880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:19.935942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:50587 (local address 127.20.244.126:34763)
0811 11:45:19.936101 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:19.936107 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:19.937139 (+ 1032us) server_negotiation.cc:407] Connection header received
0811 11:45:19.938987 (+ 1848us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:19.938992 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:19.939057 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:19.939199 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:19.940382 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:19.941317 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:19.942517 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:19.942965 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:19.943129 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:19.945538 (+ 2409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:19.945541 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:19.945544 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:19.945567 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:19.946910 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:19.947466 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:19.947470 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:19.947472 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:19.947598 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:19.947983 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:19.947990 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:19.947994 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:19.948229 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:19.948345 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:19.948931 (+ 586us) server_negotiation.cc:299] Negotiation successful
0811 11:45:19.949048 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 11:45:19.950488 26067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:19.936412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:34763 (local address 127.20.244.65:50587)
0811 11:45:19.936949 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:19.937010 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:19.938772 (+ 1762us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:19.939368 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:19.939375 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:19.939731 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:19.940216 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:19.940229 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:19.941467 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:19.941473 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:19.942374 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:19.942383 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:19.943183 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:19.943187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:19.943328 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:19.943949 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:19.943965 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:19.945362 (+ 1397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:19.947033 (+ 1671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:19.947039 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:19.947054 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:19.947354 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:19.947724 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:19.947727 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:19.947729 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:19.947873 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:19.948341 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:19.948348 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:19.948638 (+ 290us) client_negotiation.cc:769] Sending connection context
0811 11:45:19.948873 (+ 235us) client_negotiation.cc:240] Negotiation successful
0811 11:45:19.949260 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":114,"threads_started":1}
I20260811 11:45:19.951766 26065 heartbeater.cc:347] Connected to a master server at 127.20.244.126:34763
I20260811 11:45:19.952046 26065 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:19.952559 26065 heartbeater.cc:511] Master 127.20.244.126:34763 requested a full tablet report, sending...
I20260811 11:45:19.954368 25826 ts_manager.cc:194] Registered new tserver with Master: 4c77fa1ea6a5452491fdca292b9e68b1 (127.20.244.65:43335)
I20260811 11:45:19.956110 25826 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:50587
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
I20260811 11:45:19.966410 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:34763
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:37057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:20.077977 26072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:20.078238 26072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:20.078315 26072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:20.082330 26072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:20.082388 26072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:20.082505 26072 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:45:20.087656 26072 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:34763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26072
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:20.088665 26072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:20.089671 26072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:20.099118 26081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:20.099256 26072 server_base.cc:1034] running on GCE node
W20260811 11:45:20.099056 26080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:20.099066 26083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:20.099812 26072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:20.100406 26072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:20.101567 26072 hybrid_clock.cc:648] HybridClock initialized: now 1786448720101544 us; error 32 us; skew 500 ppm
Aug 11 11:45:20 dist-test-slave-vkjp krb5kdc[25781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448720, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:20.104350 26072 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:45:20.105126 26072 webserver.cc:460] Webserver started at http://127.20.244.66:37059/ using document root <none> and password file <none>
I20260811 11:45:20.105633 26072 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:20.105691 26072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:20.105849 26072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:20.107915 26072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "81ed669c680f45b4bd5832e74b7ea9e8"
format_stamp: "Formatted at 2026-08-11 11:45:20 on dist-test-slave-vkjp"
server_key: "c2a90cfd5f9872189334bcb10af9bcc5"
server_key_iv: "432fe46be0bba9dc0e0f7a1baa92aa5e"
server_key_version: "encryptionkey@0"
I20260811 11:45:20.108441 26072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "81ed669c680f45b4bd5832e74b7ea9e8"
format_stamp: "Formatted at 2026-08-11 11:45:20 on dist-test-slave-vkjp"
server_key: "c2a90cfd5f9872189334bcb10af9bcc5"
server_key_iv: "432fe46be0bba9dc0e0f7a1baa92aa5e"
server_key_version: "encryptionkey@0"
I20260811 11:45:20.112000 26072 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 11:45:20.114483 26093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:20.115685 26072 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:20.115808 26072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "81ed669c680f45b4bd5832e74b7ea9e8"
format_stamp: "Formatted at 2026-08-11 11:45:20 on dist-test-slave-vkjp"
server_key: "c2a90cfd5f9872189334bcb10af9bcc5"
server_key_iv: "432fe46be0bba9dc0e0f7a1baa92aa5e"
server_key_version: "encryptionkey@0"
I20260811 11:45:20.115908 26072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:20.130254 26072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:20.133176 26072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:20.133374 26072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:20.134186 26072 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:20.135177 26072 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:20.135227 26072 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:20.135290 26072 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:20.135322 26072 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:20.144260 26072 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:42173
I20260811 11:45:20.144297 26225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:42173 every 8 connection(s)
I20260811 11:45:20.145175 26072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:45:20.153228 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 26072
I20260811 11:45:20.153383 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:45:20.153668 21457 external_mini_cluster.cc:1428] Setting key e88326d775b25832b91e969b20d396ef
Aug 11 11:45:20 dist-test-slave-vkjp krb5kdc[25781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448720, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:20.159173 25880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:20.146935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:35533 (local address 127.20.244.126:34763)
0811 11:45:20.147075 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:20.147114 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:20.147991 (+ 877us) server_negotiation.cc:407] Connection header received
0811 11:45:20.149291 (+ 1300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:20.149293 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:20.149340 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:20.149415 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:20.150506 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:20.151018 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:20.152147 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:20.152357 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:20.152448 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:20.155222 (+ 2774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:20.155226 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:20.155227 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:20.155250 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:20.156710 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:20.157312 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:20.157315 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:20.157316 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:20.157400 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:20.157798 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:20.157800 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:20.157801 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:20.157984 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:20.158060 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:20.158732 (+ 672us) server_negotiation.cc:299] Negotiation successful
0811 11:45:20.158879 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 11:45:20.159893 26228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:20.147383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:34763 (local address 127.20.244.66:35533)
0811 11:45:20.147836 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:20.147878 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:20.149109 (+ 1231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:20.149578 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:20.149584 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:20.149913 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:20.150364 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:20.150376 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:20.151172 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:20.151175 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:20.152037 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:20.152046 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:20.152513 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:20.152517 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:20.152671 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:20.153324 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:20.153349 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:20.155016 (+ 1667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:20.156827 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:20.156833 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:20.156847 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:20.157169 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:20.157497 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:20.157502 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:20.157505 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:20.157694 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:20.158088 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:20.158096 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:20.158431 (+ 335us) client_negotiation.cc:769] Sending connection context
0811 11:45:20.158645 (+ 214us) client_negotiation.cc:240] Negotiation successful
0811 11:45:20.158945 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":123,"threads_started":1}
I20260811 11:45:20.161072 26226 heartbeater.cc:347] Connected to a master server at 127.20.244.126:34763
I20260811 11:45:20.161325 26226 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:20.161813 26226 heartbeater.cc:511] Master 127.20.244.126:34763 requested a full tablet report, sending...
I20260811 11:45:20.162921 25826 ts_manager.cc:194] Registered new tserver with Master: 81ed669c680f45b4bd5832e74b7ea9e8 (127.20.244.66:42173)
I20260811 11:45:20.163559 25826 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:35533
WARNING: no policy specified for kudu/127.20.244.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
I20260811 11:45:20.184214 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:34763
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:37057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:20.300207 26231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:20.300511 26231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:20.300586 26231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:20.304744 26231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:20.304838 26231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:20.304929 26231 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:45:20.310243 26231 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:34763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26231
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:20.311384 26231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:20.312444 26231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:20.322733 26241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:20.322780 26237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:20.322775 26238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:20.322907 26231 server_base.cc:1034] running on GCE node
I20260811 11:45:20.323397 26231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:20.324077 26231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:20.325266 26231 hybrid_clock.cc:648] HybridClock initialized: now 1786448720325235 us; error 44 us; skew 500 ppm
Aug 11 11:45:20 dist-test-slave-vkjp krb5kdc[25781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448720, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:20.328198 26231 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:45:20.329182 26231 webserver.cc:460] Webserver started at http://127.20.244.67:40479/ using document root <none> and password file <none>
I20260811 11:45:20.329764 26231 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:20.329859 26231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:20.330107 26231 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:20.332432 26231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "f60fe9ff117a451ab97b788cf689a163"
format_stamp: "Formatted at 2026-08-11 11:45:20 on dist-test-slave-vkjp"
server_key: "c05932c1b6c549de3832df47a1a6094f"
server_key_iv: "079cabaa919bbe0c67d6b6f381ddd029"
server_key_version: "encryptionkey@0"
I20260811 11:45:20.333026 26231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "f60fe9ff117a451ab97b788cf689a163"
format_stamp: "Formatted at 2026-08-11 11:45:20 on dist-test-slave-vkjp"
server_key: "c05932c1b6c549de3832df47a1a6094f"
server_key_iv: "079cabaa919bbe0c67d6b6f381ddd029"
server_key_version: "encryptionkey@0"
I20260811 11:45:20.336962 26231 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 11:45:20.339403 26251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:20.340572 26231 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 11:45:20.340723 26231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "f60fe9ff117a451ab97b788cf689a163"
format_stamp: "Formatted at 2026-08-11 11:45:20 on dist-test-slave-vkjp"
server_key: "c05932c1b6c549de3832df47a1a6094f"
server_key_iv: "079cabaa919bbe0c67d6b6f381ddd029"
server_key_version: "encryptionkey@0"
I20260811 11:45:20.340839 26231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:20.354775 26231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:20.358052 26231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:20.358250 26231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:20.358821 26231 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:20.359709 26231 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:20.359779 26231 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:20.359854 26231 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:20.359898 26231 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:20.369035 26231 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:35731
I20260811 11:45:20.369060 26384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:35731 every 8 connection(s)
I20260811 11:45:20.369903 26231 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:45:20.372010 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 26231
I20260811 11:45:20.372172 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:45:20.372534 21457 external_mini_cluster.cc:1428] Setting key ea7318eb9cef63f41218f56d8b8c2365
Aug 11 11:45:20 dist-test-slave-vkjp krb5kdc[25781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448720, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:20.383754 25880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:20.371642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:45311 (local address 127.20.244.126:34763)
0811 11:45:20.371876 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:20.371882 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:20.372769 (+ 887us) server_negotiation.cc:407] Connection header received
0811 11:45:20.374453 (+ 1684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:20.374457 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:20.374520 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:20.374631 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:20.375843 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:20.376366 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:20.377564 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:20.377853 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:20.377935 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:20.380231 (+ 2296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:20.380235 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:20.380236 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:20.380259 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:20.381780 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:20.382231 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:20.382235 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:20.382236 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:20.382330 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:20.382668 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:20.382671 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:20.382672 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:20.382855 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:20.382938 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:20.383472 (+ 534us) server_negotiation.cc:299] Negotiation successful
0811 11:45:20.383587 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260811 11:45:20.384552 26387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:20.372013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:34763 (local address 127.20.244.67:45311)
0811 11:45:20.372595 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:20.372653 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:20.374243 (+ 1590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:20.374843 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:20.374850 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:20.375257 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:20.375718 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:20.375732 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:20.376488 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:20.376490 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:20.377461 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:20.377471 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:20.377987 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:20.377989 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:20.378124 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:20.378614 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:20.378629 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:20.380083 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:20.381877 (+ 1794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:20.381881 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:20.381892 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:20.382125 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:20.382423 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:20.382425 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:20.382426 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:20.382560 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:20.382946 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:20.382951 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:20.383239 (+ 288us) client_negotiation.cc:769] Sending connection context
0811 11:45:20.383428 (+ 189us) client_negotiation.cc:240] Negotiation successful
0811 11:45:20.383733 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":157,"threads_started":1}
I20260811 11:45:20.385715 26385 heartbeater.cc:347] Connected to a master server at 127.20.244.126:34763
I20260811 11:45:20.385953 26385 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:20.386423 26385 heartbeater.cc:511] Master 127.20.244.126:34763 requested a full tablet report, sending...
I20260811 11:45:20.387449 25826 ts_manager.cc:194] Registered new tserver with Master: f60fe9ff117a451ab97b788cf689a163 (127.20.244.67:35731)
I20260811 11:45:20.388012 25826 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:45311
I20260811 11:45:20.398772 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 11:45:20 dist-test-slave-vkjp krb5kdc[25781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448720, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 11:45:20 dist-test-slave-vkjp krb5kdc[25781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448720, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.65@KRBTEST.COM
I20260811 11:45:20.425586 26394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:20.416416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36178 (local address 127.20.244.65:43335)
0811 11:45:20.416759 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:20.416774 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:20.416798 (+ 24us) server_negotiation.cc:407] Connection header received
0811 11:45:20.416849 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:20.416854 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:20.417056 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:20.417179 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:20.417819 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:20.418588 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:20.419483 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:20.419961 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:20.420066 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:20.422326 (+ 2260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:20.422336 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:20.422350 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:20.422374 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:20.423936 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:20.424325 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:20.424330 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:20.424332 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:20.424424 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:20.424653 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:20.424655 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:20.424657 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:20.424890 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:20.425063 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:20.425206 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 11:45:20.425365 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":132,"threads_started":1}
Aug 11 11:45:20 dist-test-slave-vkjp krb5kdc[25781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448720, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:20.436775 25880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:20.428554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35990 (local address 127.20.244.126:34763)
0811 11:45:20.428697 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:20.428704 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:20.428773 (+ 69us) server_negotiation.cc:407] Connection header received
0811 11:45:20.428934 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:20.428937 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:20.428991 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:20.429075 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:20.429673 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:20.430191 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:20.430977 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:20.431322 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:20.431447 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:20.433887 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:20.433890 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:20.433892 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:20.433917 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:20.435294 (+ 1377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:20.435655 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:20.435658 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:20.435659 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:20.435732 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:20.435956 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:20.435958 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:20.435959 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:20.436167 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:20.436269 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:20.436463 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 11:45:20.436579 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260811 11:45:20.437197 25826 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35990
I20260811 11:45:20.437784 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 25910
I20260811 11:45:20.447479 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 26072
I20260811 11:45:20.456192 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 26231
I20260811 11:45:20.465261 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 25796
2026-08-11T11:45:20Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2310 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:45:20 dist-test-slave-vkjp krb5kdc[26399](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:45:20 dist-test-slave-vkjp krb5kdc[26399](info): set up 2 sockets
Aug 11 11:45:20 dist-test-slave-vkjp krb5kdc[26399](info): commencing operation
krb5kdc: starting...
W20260811 11:45:21.623833 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:45:21 dist-test-slave-vkjp krb5kdc[26399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448721, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:45:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:45:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:45:21.755976 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:37483
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:34587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:37483
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:21.871801 26416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:21.872081 26416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:21.872159 26416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:21.876221 26416 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:21.876289 26416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:21.876317 26416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:21.876384 26416 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:21.876411 26416 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:45:21.882139 26416 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:34587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:37483
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:37483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:21.883224 26416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:21.884274 26416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:21.892751 26423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:21.892751 26426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:21.893028 26416 server_base.cc:1034] running on GCE node
W20260811 11:45:21.892777 26422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:21.893679 26416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:21.894753 26416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:21.895977 26416 hybrid_clock.cc:648] HybridClock initialized: now 1786448721895930 us; error 62 us; skew 500 ppm
Aug 11 11:45:21 dist-test-slave-vkjp krb5kdc[26399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448721, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:21.904608 26416 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:45:21.905400 26416 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:21.905468 26416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:21.905646 26416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:21.907863 26416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "ad3d1200c68f4580a8ad3171be7dffd7"
format_stamp: "Formatted at 2026-08-11 11:45:21 on dist-test-slave-vkjp"
server_key: "cdb7eed9a1572a52a9fb112bd9bd9f68"
server_key_iv: "e79e2deddfbbfc4a44a3a07f18f05ee4"
server_key_version: "encryptionkey@0"
I20260811 11:45:21.908452 26416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "ad3d1200c68f4580a8ad3171be7dffd7"
format_stamp: "Formatted at 2026-08-11 11:45:21 on dist-test-slave-vkjp"
server_key: "cdb7eed9a1572a52a9fb112bd9bd9f68"
server_key_iv: "e79e2deddfbbfc4a44a3a07f18f05ee4"
server_key_version: "encryptionkey@0"
I20260811 11:45:21.912135 26416 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 11:45:21.914602 26432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:21.915963 26416 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:45:21.916131 26416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "ad3d1200c68f4580a8ad3171be7dffd7"
format_stamp: "Formatted at 2026-08-11 11:45:21 on dist-test-slave-vkjp"
server_key: "cdb7eed9a1572a52a9fb112bd9bd9f68"
server_key_iv: "e79e2deddfbbfc4a44a3a07f18f05ee4"
server_key_version: "encryptionkey@0"
I20260811 11:45:21.916255 26416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:21.985113 26416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:21.988462 26416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:21.988705 26416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:21.996093 26416 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:37483
I20260811 11:45:21.996382 26496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:37483 every 8 connection(s)
I20260811 11:45:21.996817 26416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:45:21.999655 26497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:22.004555 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 26416
I20260811 11:45:22.004717 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:45:22.005018 21457 external_mini_cluster.cc:1428] Setting key e79dc4f38b7d007883d13b01f397b542
I20260811 11:45:22.005748 26497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7: Bootstrap starting.
I20260811 11:45:22.008288 26497 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:22.009070 26497 log.cc:824] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:22.011034 26497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7: No bootstrap required, opened a new log
Aug 11 11:45:22 dist-test-slave-vkjp krb5kdc[26399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448721, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:22.014837 26497 raft_consensus.cc:348] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad3d1200c68f4580a8ad3171be7dffd7" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37483 } }
I20260811 11:45:22.015195 26497 raft_consensus.cc:374] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:22.015292 26497 raft_consensus.cc:729] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad3d1200c68f4580a8ad3171be7dffd7, State: Initialized, Role: FOLLOWER
I20260811 11:45:22.015838 26497 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad3d1200c68f4580a8ad3171be7dffd7" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37483 } }
I20260811 11:45:22.016021 26497 raft_consensus.cc:388] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:45:22.016119 26497 raft_consensus.cc:482] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:45:22.016223 26497 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:22.017330 26497 raft_consensus.cc:504] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad3d1200c68f4580a8ad3171be7dffd7" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37483 } }
I20260811 11:45:22.017685 26497 leader_election.cc:302] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad3d1200c68f4580a8ad3171be7dffd7; no voters:
I20260811 11:45:22.018059 26497 leader_election.cc:288] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:45:22.018186 26502 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:22.018437 26502 raft_consensus.cc:686] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7 [term 1 LEADER]: Becoming Leader. State: Replica: ad3d1200c68f4580a8ad3171be7dffd7, State: Running, Role: LEADER
I20260811 11:45:22.018848 26502 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad3d1200c68f4580a8ad3171be7dffd7" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37483 } }
I20260811 11:45:22.019450 26497 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:45:22.020629 26500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:22.006511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36978 (local address 127.20.244.126:37483)
0811 11:45:22.006992 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:22.007007 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:22.007044 (+ 37us) server_negotiation.cc:407] Connection header received
0811 11:45:22.007805 (+ 761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:22.007824 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:22.008155 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:22.008496 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:22.009394 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.010359 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.011281 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.011770 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.011956 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:22.014500 (+ 2544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:22.014505 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:22.014519 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:22.014546 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:22.016608 (+ 2062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:22.017109 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:22.017115 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:22.017121 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:22.017313 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:22.017575 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:22.017579 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:22.017581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:22.018102 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:22.019073 (+ 971us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:22.019261 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 11:45:22.019568 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":148,"threads_started":1}
I20260811 11:45:22.020710 26504 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad3d1200c68f4580a8ad3171be7dffd7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad3d1200c68f4580a8ad3171be7dffd7" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37483 } } }
I20260811 11:45:22.020952 26504 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:22.020961 26505 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad3d1200c68f4580a8ad3171be7dffd7. Latest consensus state: current_term: 1 leader_uuid: "ad3d1200c68f4580a8ad3171be7dffd7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad3d1200c68f4580a8ad3171be7dffd7" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37483 } } }
I20260811 11:45:22.021106 26505 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:22.022251 26512 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:45:22.025555 26512 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:45:22.031656 26512 catalog_manager.cc:1347] Generated new cluster ID: a094f3b1ba6040e7af646ce8187f85bf
I20260811 11:45:22.031733 26512 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:45:22.043709 26512 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:45:22.044919 26512 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:45:22.053264 26512 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7: Generated new TSK 0
I20260811 11:45:22.054049 26512 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.244.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
I20260811 11:45:22.082275 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:37483
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:34587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:22.198041 26525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:22.198284 26525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:22.198328 26525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:22.202284 26525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:22.202338 26525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:22.202426 26525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:45:22.207544 26525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:34587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:37483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:22.208635 26525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:22.209648 26525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:22.219441 26534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:22.219537 26532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:22.219475 26531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:22.219638 26525 server_base.cc:1034] running on GCE node
I20260811 11:45:22.220192 26525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:22.221057 26525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:22.222249 26525 hybrid_clock.cc:648] HybridClock initialized: now 1786448722222235 us; error 28 us; skew 500 ppm
Aug 11 11:45:22 dist-test-slave-vkjp krb5kdc[26399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448722, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:22.225129 26525 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:45:22.225948 26525 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:22.226045 26525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:22.226289 26525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:22.228462 26525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "f4a56e37cfea4dd488fb0d02bbbd109c"
format_stamp: "Formatted at 2026-08-11 11:45:22 on dist-test-slave-vkjp"
server_key: "fb999aa959b395db2b92fdc534c561db"
server_key_iv: "d35d1434e6577d10b71005b71d307380"
server_key_version: "encryptionkey@0"
I20260811 11:45:22.229044 26525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "f4a56e37cfea4dd488fb0d02bbbd109c"
format_stamp: "Formatted at 2026-08-11 11:45:22 on dist-test-slave-vkjp"
server_key: "fb999aa959b395db2b92fdc534c561db"
server_key_iv: "d35d1434e6577d10b71005b71d307380"
server_key_version: "encryptionkey@0"
I20260811 11:45:22.232772 26525 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260811 11:45:22.235008 26541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:22.236209 26525 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:22.236351 26525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "f4a56e37cfea4dd488fb0d02bbbd109c"
format_stamp: "Formatted at 2026-08-11 11:45:22 on dist-test-slave-vkjp"
server_key: "fb999aa959b395db2b92fdc534c561db"
server_key_iv: "d35d1434e6577d10b71005b71d307380"
server_key_version: "encryptionkey@0"
I20260811 11:45:22.236474 26525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:22.277956 26525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:22.281612 26525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:22.281836 26525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:22.282490 26525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:22.283408 26525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:22.283488 26525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:22.283561 26525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:22.283615 26525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:22.292851 26525 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:34111
I20260811 11:45:22.292876 26674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:34111 every 8 connection(s)
I20260811 11:45:22.293515 26525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:45:22.299612 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 26525
I20260811 11:45:22.299759 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:45:22.300091 21457 external_mini_cluster.cc:1428] Setting key d1b3b0837399bff101b8d7ef1eef4bf1
Aug 11 11:45:22 dist-test-slave-vkjp krb5kdc[26399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448722, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:22.308131 26500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:22.295308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:34687 (local address 127.20.244.126:37483)
0811 11:45:22.295494 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:22.295498 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:22.296348 (+ 850us) server_negotiation.cc:407] Connection header received
0811 11:45:22.297577 (+ 1229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:22.297580 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:22.297638 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:22.297714 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:22.298854 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.299469 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.301020 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.301243 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.301321 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:22.304334 (+ 3013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:22.304338 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:22.304340 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:22.304365 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:22.305843 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:22.306389 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:22.306392 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:22.306393 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:22.306477 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:22.306832 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:22.306836 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:22.306838 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:22.307034 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:22.307229 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:22.307887 (+ 658us) server_negotiation.cc:299] Negotiation successful
0811 11:45:22.308010 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 11:45:22.309444 26677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:22.295728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:37483 (local address 127.20.244.65:34687)
0811 11:45:22.296184 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:22.296230 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:22.297374 (+ 1144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:22.297882 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:22.297889 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:22.298235 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:22.298717 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:22.298731 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.299606 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.299610 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:22.300877 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:22.300890 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.301409 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.301413 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:22.301653 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:22.302308 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:22.302325 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:22.304146 (+ 1821us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:22.305975 (+ 1829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:22.305981 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:22.305996 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:22.306263 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:22.306575 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:22.306579 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:22.306581 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:22.306731 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:22.307230 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:22.307238 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:22.307590 (+ 352us) client_negotiation.cc:769] Sending connection context
0811 11:45:22.307842 (+ 252us) client_negotiation.cc:240] Negotiation successful
0811 11:45:22.308254 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":117,"threads_started":1}
I20260811 11:45:22.310765 26675 heartbeater.cc:347] Connected to a master server at 127.20.244.126:37483
I20260811 11:45:22.311028 26675 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.20.244.66@KRBTEST.COM; defaulting to no policy
I20260811 11:45:22.311553 26675 heartbeater.cc:511] Master 127.20.244.126:37483 requested a full tablet report, sending...
I20260811 11:45:22.313060 26455 ts_manager.cc:194] Registered new tserver with Master: f4a56e37cfea4dd488fb0d02bbbd109c (127.20.244.65:34111)
I20260811 11:45:22.314448 26455 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:34687
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
I20260811 11:45:22.332918 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:37483
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:34587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:22.459046 26680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:22.459431 26680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:22.459518 26680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:22.463825 26680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:22.463879 26680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:22.464015 26680 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:45:22.469456 26680 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:34587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:37483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:22.470855 26680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:22.472054 26680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:22.481832 26685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:22.481827 26686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:22.481832 26688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:22.482151 26680 server_base.cc:1034] running on GCE node
I20260811 11:45:22.482573 26680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:22.483325 26680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:22.484503 26680 hybrid_clock.cc:648] HybridClock initialized: now 1786448722484490 us; error 24 us; skew 500 ppm
Aug 11 11:45:22 dist-test-slave-vkjp krb5kdc[26399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448722, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:22.487371 26680 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:45:22.488193 26680 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:22.488291 26680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:22.488520 26680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:22.490707 26680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "1434e4845b084ea696de3d819fe57801"
format_stamp: "Formatted at 2026-08-11 11:45:22 on dist-test-slave-vkjp"
server_key: "52c13832cc55ffc9c51a17c7cf25ff77"
server_key_iv: "e2c083e4daaa52ef292a385085454f02"
server_key_version: "encryptionkey@0"
I20260811 11:45:22.491405 26680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "1434e4845b084ea696de3d819fe57801"
format_stamp: "Formatted at 2026-08-11 11:45:22 on dist-test-slave-vkjp"
server_key: "52c13832cc55ffc9c51a17c7cf25ff77"
server_key_iv: "e2c083e4daaa52ef292a385085454f02"
server_key_version: "encryptionkey@0"
I20260811 11:45:22.495183 26680 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:45:22.497633 26695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:22.498924 26680 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:22.499064 26680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "1434e4845b084ea696de3d819fe57801"
format_stamp: "Formatted at 2026-08-11 11:45:22 on dist-test-slave-vkjp"
server_key: "52c13832cc55ffc9c51a17c7cf25ff77"
server_key_iv: "e2c083e4daaa52ef292a385085454f02"
server_key_version: "encryptionkey@0"
I20260811 11:45:22.499243 26680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:22.521705 26680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:22.524814 26680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:22.525027 26680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:22.525632 26680 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:22.526616 26680 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:22.526691 26680 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:22.526767 26680 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:22.526818 26680 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:22.536137 26680 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:46675
I20260811 11:45:22.536163 26835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:46675 every 8 connection(s)
I20260811 11:45:22.536772 26680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:45:22.540789 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 26680
I20260811 11:45:22.540951 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:45:22.541311 21457 external_mini_cluster.cc:1428] Setting key 78eb1218e67fd5e3ef303dede50fd55d
Aug 11 11:45:22 dist-test-slave-vkjp krb5kdc[26399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448722, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:22.550755 26500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:22.538539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:49635 (local address 127.20.244.126:37483)
0811 11:45:22.538688 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:22.538691 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:22.539942 (+ 1251us) server_negotiation.cc:407] Connection header received
0811 11:45:22.540903 (+ 961us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:22.540924 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:22.541003 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:22.541110 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:22.542423 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.542941 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.544123 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.544358 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.544472 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:22.546948 (+ 2476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:22.546957 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:22.546959 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:22.546982 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:22.548620 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:22.549188 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:22.549198 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:22.549200 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:22.549279 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:22.549618 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:22.549622 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:22.549624 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:22.549818 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:22.549932 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:22.550447 (+ 515us) server_negotiation.cc:299] Negotiation successful
0811 11:45:22.550580 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
WARNING: no policy specified for kudu/127.20.244.67@KRBTEST.COM; defaulting to no policy
I20260811 11:45:22.551751 26839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:22.538903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:37483 (local address 127.20.244.66:49635)
0811 11:45:22.539818 (+ 915us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:22.539859 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:22.540673 (+ 814us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:22.541276 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:22.541284 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:22.541694 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:22.542273 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:22.542289 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.543066 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.543069 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:22.543992 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:22.544001 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.544514 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.544517 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:22.544689 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:22.545312 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:22.545329 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:22.546773 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:22.548764 (+ 1991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:22.548771 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:22.548794 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:22.549075 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:22.549374 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:22.549377 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:22.549379 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:22.549519 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:22.549931 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:22.549939 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:22.550200 (+ 261us) client_negotiation.cc:769] Sending connection context
0811 11:45:22.550402 (+ 202us) client_negotiation.cc:240] Negotiation successful
0811 11:45:22.550736 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":161,"threads_started":1}
I20260811 11:45:22.553045 26837 heartbeater.cc:347] Connected to a master server at 127.20.244.126:37483
I20260811 11:45:22.553305 26837 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:22.553798 26837 heartbeater.cc:511] Master 127.20.244.126:37483 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.67@KRBTEST.COM" created.
I20260811 11:45:22.554934 26455 ts_manager.cc:194] Registered new tserver with Master: 1434e4845b084ea696de3d819fe57801 (127.20.244.66:46675)
I20260811 11:45:22.555833 26455 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:49635
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
I20260811 11:45:22.574467 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:37483
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:34587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:22.691128 26843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:22.691416 26843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:22.691501 26843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:22.696022 26843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:22.696120 26843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:22.696254 26843 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:45:22.701697 26843 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:34587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:37483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:22.702845 26843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:22.703992 26843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:22.713445 26849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:22.713451 26848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:22.713474 26851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:22.713967 26843 server_base.cc:1034] running on GCE node
I20260811 11:45:22.714378 26843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:22.714958 26843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:22.716121 26843 hybrid_clock.cc:648] HybridClock initialized: now 1786448722716106 us; error 31 us; skew 500 ppm
Aug 11 11:45:22 dist-test-slave-vkjp krb5kdc[26399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448722, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:22.719048 26843 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:45:22.720010 26843 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:22.720108 26843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:22.720345 26843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:22.722719 26843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "3169f35409af43e8a7029f17964d7f10"
format_stamp: "Formatted at 2026-08-11 11:45:22 on dist-test-slave-vkjp"
server_key: "c7a058124b071272312623c20fe4f951"
server_key_iv: "91989c0646eee2ce8382f220f8468f34"
server_key_version: "encryptionkey@0"
I20260811 11:45:22.723361 26843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "3169f35409af43e8a7029f17964d7f10"
format_stamp: "Formatted at 2026-08-11 11:45:22 on dist-test-slave-vkjp"
server_key: "c7a058124b071272312623c20fe4f951"
server_key_iv: "91989c0646eee2ce8382f220f8468f34"
server_key_version: "encryptionkey@0"
I20260811 11:45:22.727229 26843 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 11:45:22.729681 26858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:22.730914 26843 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:22.731058 26843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "3169f35409af43e8a7029f17964d7f10"
format_stamp: "Formatted at 2026-08-11 11:45:22 on dist-test-slave-vkjp"
server_key: "c7a058124b071272312623c20fe4f951"
server_key_iv: "91989c0646eee2ce8382f220f8468f34"
server_key_version: "encryptionkey@0"
I20260811 11:45:22.731240 26843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:22.760665 26843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:22.764271 26843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:22.764498 26843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:22.765139 26843 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:22.766026 26843 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:22.766078 26843 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:22.766157 26843 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:22.766201 26843 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:22.776044 26843 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:35443
I20260811 11:45:22.776073 26995 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:35443 every 8 connection(s)
I20260811 11:45:22.776685 26843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:45:22.782330 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 26843
I20260811 11:45:22.782476 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:45:22.782778 21457 external_mini_cluster.cc:1428] Setting key ed8a7238612d38581b0c09e825ced37b
Aug 11 11:45:22 dist-test-slave-vkjp krb5kdc[26399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448722, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:22.790880 26500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:22.778500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:55993 (local address 127.20.244.126:37483)
0811 11:45:22.778661 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:22.778665 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:22.779573 (+ 908us) server_negotiation.cc:407] Connection header received
0811 11:45:22.780860 (+ 1287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:22.780863 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:22.780931 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:22.781044 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:22.782324 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.783034 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.784472 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.784685 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.784767 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:22.787500 (+ 2733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:22.787506 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:22.787509 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:22.787540 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:22.788950 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:22.789453 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:22.789455 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:22.789456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:22.789531 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:22.789831 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:22.789833 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:22.789834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:22.790013 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:22.790088 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:22.790648 (+ 560us) server_negotiation.cc:299] Negotiation successful
0811 11:45:22.790756 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 11:45:22.791752 26998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:22.778912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:37483 (local address 127.20.244.67:55993)
0811 11:45:22.779414 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:22.779465 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:22.780643 (+ 1178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:22.781223 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:22.781230 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:22.781595 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:22.782102 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:22.782123 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.783232 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.783235 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:22.784338 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:22.784349 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.784836 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.784841 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:22.785051 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:22.785666 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:22.785683 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:22.787320 (+ 1637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:22.789068 (+ 1748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:22.789073 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:22.789086 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:22.789363 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:22.789611 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:22.789613 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:22.789614 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:22.789748 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:22.790106 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:22.790111 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:22.790434 (+ 323us) client_negotiation.cc:769] Sending connection context
0811 11:45:22.790600 (+ 166us) client_negotiation.cc:240] Negotiation successful
0811 11:45:22.790860 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":165,"threads_started":1}
I20260811 11:45:22.792906 26996 heartbeater.cc:347] Connected to a master server at 127.20.244.126:37483
I20260811 11:45:22.793167 26996 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:22.793637 26996 heartbeater.cc:511] Master 127.20.244.126:37483 requested a full tablet report, sending...
I20260811 11:45:22.794735 26455 ts_manager.cc:194] Registered new tserver with Master: 3169f35409af43e8a7029f17964d7f10 (127.20.244.67:35443)
I20260811 11:45:22.795449 26455 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:55993
I20260811 11:45:22.797150 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:45:22.806613 26500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:22.799288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36980 (local address 127.20.244.126:37483)
0811 11:45:22.799419 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:22.799425 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:22.799585 (+ 160us) server_negotiation.cc:407] Connection header received
0811 11:45:22.799675 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:22.799678 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:22.799717 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:22.799808 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:22.800477 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.801068 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.801859 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.802086 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.802170 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:22.803590 (+ 1420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:22.803594 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:22.803596 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:22.803646 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:22.805032 (+ 1386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:22.805437 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:22.805440 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:22.805441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:22.805522 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:22.805829 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:22.805832 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:22.805834 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:22.806067 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:22.806190 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:22.806377 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 11:45:22.806485 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 11:45:22.809566 26455 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36980:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:45:22.812876 26455 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:45:22.829650 27009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:22.822763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:46675 (local address 127.0.0.1:55848)
0811 11:45:22.823781 (+ 1018us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:22.823795 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:22.823900 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:22.825754 (+ 1854us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:22.825759 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:22.825783 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:22.825930 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:22.825937 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.827183 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.827186 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:22.828181 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:22.828192 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.829156 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.829159 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:22.829253 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:22.829278 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 11:45:22.829357 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 11:45:22.829505 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":962,"mutex_wait_us":126,"thread_start_us":98,"threads_started":1}
I20260811 11:45:22.829648 27010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:22.822177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47348 (local address 127.20.244.67:35443)
0811 11:45:22.822803 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:22.822818 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:22.823157 (+ 339us) server_negotiation.cc:407] Connection header received
0811 11:45:22.823423 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:22.823430 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:22.823661 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:22.823822 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:22.824401 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.825597 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.827999 (+ 2402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.828704 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.828796 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:22.828903 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:22.829358 (+ 455us) server_negotiation.cc:299] Negotiation successful
0811 11:45:22.829474 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":199,"threads_started":1}
I20260811 11:45:22.830106 27008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:22.822006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:35443 (local address 127.0.0.1:47348)
0811 11:45:22.822977 (+ 971us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:22.823032 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:22.823244 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:22.824070 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:22.824073 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:22.824092 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:22.824250 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:22.824257 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.825741 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.825744 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:22.827858 (+ 2114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:22.827871 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.828845 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.828849 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:22.828969 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:22.829020 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 11:45:22.829865 (+ 845us) client_negotiation.cc:240] Negotiation successful
0811 11:45:22.829952 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":789,"mutex_wait_us":513,"thread_start_us":97,"threads_started":1}
I20260811 11:45:22.830116 27016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:22.823222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55848 (local address 127.20.244.66:46675)
0811 11:45:22.823654 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:22.823664 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:22.823904 (+ 240us) server_negotiation.cc:407] Connection header received
0811 11:45:22.824020 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:22.824026 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:22.824220 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:22.824398 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:22.826065 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.826983 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.828334 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.829019 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.829146 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:22.829298 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:22.829391 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 11:45:22.829952 (+ 561us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":129,"threads_started":1}
I20260811 11:45:22.830680 27011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:22.822209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:34111 (local address 127.0.0.1:48348)
0811 11:45:22.823006 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:22.823053 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:22.823212 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:22.823987 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:22.823995 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:22.824015 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:22.824158 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:22.824163 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.825883 (+ 1720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.825887 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:22.827858 (+ 1971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:22.827871 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.830312 (+ 2441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.830316 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:22.830409 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:22.830437 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 11:45:22.830492 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 11:45:22.830566 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":734,"mutex_wait_us":138,"thread_start_us":87,"threads_started":1}
I20260811 11:45:22.831416 27012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:22.823227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48348 (local address 127.20.244.65:34111)
0811 11:45:22.823502 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:22.823509 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:22.823531 (+ 22us) server_negotiation.cc:407] Connection header received
0811 11:45:22.823608 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:22.823614 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:22.823804 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:22.824282 (+ 478us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:22.824447 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.825597 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.828967 (+ 3370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.830094 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.830977 (+ 883us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:22.831141 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:22.831195 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 11:45:22.831283 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":108,"threads_started":1}
I20260811 11:45:22.832898 26917 tablet_service.cc:1467] Processing CreateTablet for tablet a7a385bf6e234317ad5c73b89171d7af (DEFAULT_TABLE table=test-table [id=6f54e90f2f494debb7361b263597f4dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:22.832901 26755 tablet_service.cc:1467] Processing CreateTablet for tablet a7a385bf6e234317ad5c73b89171d7af (DEFAULT_TABLE table=test-table [id=6f54e90f2f494debb7361b263597f4dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:22.834044 26917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7a385bf6e234317ad5c73b89171d7af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:22.834111 26755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7a385bf6e234317ad5c73b89171d7af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:22.836517 26602 tablet_service.cc:1467] Processing CreateTablet for tablet a7a385bf6e234317ad5c73b89171d7af (DEFAULT_TABLE table=test-table [id=6f54e90f2f494debb7361b263597f4dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:22.837608 26602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7a385bf6e234317ad5c73b89171d7af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:22.840442 27017 tablet_bootstrap.cc:492] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10: Bootstrap starting.
I20260811 11:45:22.842758 27017 tablet_bootstrap.cc:654] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:22.843492 27018 tablet_bootstrap.cc:492] T a7a385bf6e234317ad5c73b89171d7af P 1434e4845b084ea696de3d819fe57801: Bootstrap starting.
I20260811 11:45:22.844116 27017 log.cc:824] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:22.845701 27021 tablet_bootstrap.cc:492] T a7a385bf6e234317ad5c73b89171d7af P f4a56e37cfea4dd488fb0d02bbbd109c: Bootstrap starting.
I20260811 11:45:22.846146 27017 tablet_bootstrap.cc:492] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10: No bootstrap required, opened a new log
I20260811 11:45:22.846349 27017 ts_tablet_manager.cc:1397] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 11:45:22.846378 27018 tablet_bootstrap.cc:654] T a7a385bf6e234317ad5c73b89171d7af P 1434e4845b084ea696de3d819fe57801: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:22.847208 27018 log.cc:824] T a7a385bf6e234317ad5c73b89171d7af P 1434e4845b084ea696de3d819fe57801: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:22.848150 27021 tablet_bootstrap.cc:654] T a7a385bf6e234317ad5c73b89171d7af P f4a56e37cfea4dd488fb0d02bbbd109c: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:22.848976 27021 log.cc:824] T a7a385bf6e234317ad5c73b89171d7af P f4a56e37cfea4dd488fb0d02bbbd109c: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:22.849143 27018 tablet_bootstrap.cc:492] T a7a385bf6e234317ad5c73b89171d7af P 1434e4845b084ea696de3d819fe57801: No bootstrap required, opened a new log
I20260811 11:45:22.849360 27018 ts_tablet_manager.cc:1397] T a7a385bf6e234317ad5c73b89171d7af P 1434e4845b084ea696de3d819fe57801: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 11:45:22.850468 27017 raft_consensus.cc:348] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3169f35409af43e8a7029f17964d7f10" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35443 } } peers { permanent_uuid: "f4a56e37cfea4dd488fb0d02bbbd109c" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34111 } } peers { permanent_uuid: "1434e4845b084ea696de3d819fe57801" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 46675 } }
I20260811 11:45:22.850765 27017 raft_consensus.cc:374] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:22.850831 27017 raft_consensus.cc:729] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3169f35409af43e8a7029f17964d7f10, State: Initialized, Role: FOLLOWER
I20260811 11:45:22.851361 27021 tablet_bootstrap.cc:492] T a7a385bf6e234317ad5c73b89171d7af P f4a56e37cfea4dd488fb0d02bbbd109c: No bootstrap required, opened a new log
I20260811 11:45:22.851411 27017 consensus_queue.cc:260] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3169f35409af43e8a7029f17964d7f10" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35443 } } peers { permanent_uuid: "f4a56e37cfea4dd488fb0d02bbbd109c" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34111 } } peers { permanent_uuid: "1434e4845b084ea696de3d819fe57801" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 46675 } }
I20260811 11:45:22.851557 27021 ts_tablet_manager.cc:1397] T a7a385bf6e234317ad5c73b89171d7af P f4a56e37cfea4dd488fb0d02bbbd109c: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 11:45:22.852111 26996 heartbeater.cc:503] Master 127.20.244.126:37483 was elected leader, sending a full tablet report...
I20260811 11:45:22.853372 27018 raft_consensus.cc:348] T a7a385bf6e234317ad5c73b89171d7af P 1434e4845b084ea696de3d819fe57801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3169f35409af43e8a7029f17964d7f10" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35443 } } peers { permanent_uuid: "f4a56e37cfea4dd488fb0d02bbbd109c" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34111 } } peers { permanent_uuid: "1434e4845b084ea696de3d819fe57801" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 46675 } }
I20260811 11:45:22.853605 27017 ts_tablet_manager.cc:1428] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 11:45:22.853660 27018 raft_consensus.cc:374] T a7a385bf6e234317ad5c73b89171d7af P 1434e4845b084ea696de3d819fe57801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:22.853714 27018 raft_consensus.cc:729] T a7a385bf6e234317ad5c73b89171d7af P 1434e4845b084ea696de3d819fe57801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1434e4845b084ea696de3d819fe57801, State: Initialized, Role: FOLLOWER
I20260811 11:45:22.854161 27018 consensus_queue.cc:260] T a7a385bf6e234317ad5c73b89171d7af P 1434e4845b084ea696de3d819fe57801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3169f35409af43e8a7029f17964d7f10" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35443 } } peers { permanent_uuid: "f4a56e37cfea4dd488fb0d02bbbd109c" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34111 } } peers { permanent_uuid: "1434e4845b084ea696de3d819fe57801" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 46675 } }
I20260811 11:45:22.854877 26837 heartbeater.cc:503] Master 127.20.244.126:37483 was elected leader, sending a full tablet report...
I20260811 11:45:22.855297 27018 ts_tablet_manager.cc:1428] T a7a385bf6e234317ad5c73b89171d7af P 1434e4845b084ea696de3d819fe57801: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 11:45:22.855860 27021 raft_consensus.cc:348] T a7a385bf6e234317ad5c73b89171d7af P f4a56e37cfea4dd488fb0d02bbbd109c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3169f35409af43e8a7029f17964d7f10" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35443 } } peers { permanent_uuid: "f4a56e37cfea4dd488fb0d02bbbd109c" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34111 } } peers { permanent_uuid: "1434e4845b084ea696de3d819fe57801" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 46675 } }
I20260811 11:45:22.856112 27021 raft_consensus.cc:374] T a7a385bf6e234317ad5c73b89171d7af P f4a56e37cfea4dd488fb0d02bbbd109c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:22.856191 27021 raft_consensus.cc:729] T a7a385bf6e234317ad5c73b89171d7af P f4a56e37cfea4dd488fb0d02bbbd109c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a56e37cfea4dd488fb0d02bbbd109c, State: Initialized, Role: FOLLOWER
I20260811 11:45:22.856608 27021 consensus_queue.cc:260] T a7a385bf6e234317ad5c73b89171d7af P f4a56e37cfea4dd488fb0d02bbbd109c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3169f35409af43e8a7029f17964d7f10" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35443 } } peers { permanent_uuid: "f4a56e37cfea4dd488fb0d02bbbd109c" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34111 } } peers { permanent_uuid: "1434e4845b084ea696de3d819fe57801" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 46675 } }
I20260811 11:45:22.857347 26675 heartbeater.cc:503] Master 127.20.244.126:37483 was elected leader, sending a full tablet report...
I20260811 11:45:22.857601 27021 ts_tablet_manager.cc:1428] T a7a385bf6e234317ad5c73b89171d7af P f4a56e37cfea4dd488fb0d02bbbd109c: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 11:45:22.957118 27025 raft_consensus.cc:482] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:45:22.957350 27025 raft_consensus.cc:504] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3169f35409af43e8a7029f17964d7f10" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35443 } } peers { permanent_uuid: "f4a56e37cfea4dd488fb0d02bbbd109c" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34111 } } peers { permanent_uuid: "1434e4845b084ea696de3d819fe57801" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 46675 } }
I20260811 11:45:22.958535 27025 leader_election.cc:288] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4a56e37cfea4dd488fb0d02bbbd109c (127.20.244.65:34111), 1434e4845b084ea696de3d819fe57801 (127.20.244.66:46675)
I20260811 11:45:22.962667 27016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:22.959022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:39787 (local address 127.20.244.66:46675)
0811 11:45:22.959186 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:22.959191 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:22.959208 (+ 17us) server_negotiation.cc:407] Connection header received
0811 11:45:22.959272 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:22.959275 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:22.959338 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:22.959436 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:22.959776 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.960333 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.961591 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.962042 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.962185 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:22.962244 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:22.962449 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 11:45:22.962523 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 11:45:22.962675 26998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:22.958837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:46675 (local address 127.20.244.67:39787)
0811 11:45:22.959003 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:22.959021 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:22.959169 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:22.959454 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:22.959457 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:22.959477 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:22.959609 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:22.959615 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.960465 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.960469 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:22.961444 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:22.961454 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.962181 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.962185 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:22.962309 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:22.962328 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 11:45:22.962428 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 11:45:22.962504 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":40}
I20260811 11:45:22.962697 27012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:22.958973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:33519 (local address 127.20.244.65:34111)
0811 11:45:22.959114 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:22.959120 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:22.959522 (+ 402us) server_negotiation.cc:407] Connection header received
0811 11:45:22.959684 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:22.959687 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:22.959736 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:22.959822 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:22.960095 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.960587 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.961707 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.962116 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.962258 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:22.962309 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:22.962507 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 11:45:22.962574 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 11:45:22.962710 27029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:22.958837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:34111 (local address 127.20.244.67:33519)
0811 11:45:22.959416 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:22.959429 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:22.959563 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:22.959835 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:22.959838 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:22.959854 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:22.959980 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:22.959986 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.960705 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.960710 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:22.961576 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:22.961585 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:22.962257 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:22.962260 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:22.962377 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:22.962395 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 11:45:22.962488 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 11:45:22.962556 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"mutex_wait_us":220,"thread_start_us":173,"threads_started":1}
I20260811 11:45:22.963410 26779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7a385bf6e234317ad5c73b89171d7af" candidate_uuid: "3169f35409af43e8a7029f17964d7f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1434e4845b084ea696de3d819fe57801" is_pre_election: true
I20260811 11:45:22.963411 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7a385bf6e234317ad5c73b89171d7af" candidate_uuid: "3169f35409af43e8a7029f17964d7f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a56e37cfea4dd488fb0d02bbbd109c" is_pre_election: true
I20260811 11:45:22.963749 26624 raft_consensus.cc:2454] T a7a385bf6e234317ad5c73b89171d7af P f4a56e37cfea4dd488fb0d02bbbd109c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3169f35409af43e8a7029f17964d7f10 in term 0.
I20260811 11:45:22.963749 26779 raft_consensus.cc:2454] T a7a385bf6e234317ad5c73b89171d7af P 1434e4845b084ea696de3d819fe57801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3169f35409af43e8a7029f17964d7f10 in term 0.
I20260811 11:45:22.964310 26860 leader_election.cc:302] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1434e4845b084ea696de3d819fe57801, 3169f35409af43e8a7029f17964d7f10, f4a56e37cfea4dd488fb0d02bbbd109c; no voters:
I20260811 11:45:22.964623 27025 raft_consensus.cc:2781] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:45:22.964708 27025 raft_consensus.cc:482] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:45:22.964742 27025 raft_consensus.cc:3037] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:22.965934 27025 raft_consensus.cc:504] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3169f35409af43e8a7029f17964d7f10" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35443 } } peers { permanent_uuid: "f4a56e37cfea4dd488fb0d02bbbd109c" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34111 } } peers { permanent_uuid: "1434e4845b084ea696de3d819fe57801" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 46675 } }
I20260811 11:45:22.966367 27025 leader_election.cc:288] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10 [CANDIDATE]: Term 1 election: Requested vote from peers f4a56e37cfea4dd488fb0d02bbbd109c (127.20.244.65:34111), 1434e4845b084ea696de3d819fe57801 (127.20.244.66:46675)
I20260811 11:45:22.966744 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7a385bf6e234317ad5c73b89171d7af" candidate_uuid: "3169f35409af43e8a7029f17964d7f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a56e37cfea4dd488fb0d02bbbd109c"
I20260811 11:45:22.966794 26779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7a385bf6e234317ad5c73b89171d7af" candidate_uuid: "3169f35409af43e8a7029f17964d7f10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1434e4845b084ea696de3d819fe57801"
I20260811 11:45:22.966882 26624 raft_consensus.cc:3037] T a7a385bf6e234317ad5c73b89171d7af P f4a56e37cfea4dd488fb0d02bbbd109c [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:22.966948 26779 raft_consensus.cc:3037] T a7a385bf6e234317ad5c73b89171d7af P 1434e4845b084ea696de3d819fe57801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:22.968020 26624 raft_consensus.cc:2454] T a7a385bf6e234317ad5c73b89171d7af P f4a56e37cfea4dd488fb0d02bbbd109c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3169f35409af43e8a7029f17964d7f10 in term 1.
I20260811 11:45:22.968111 26779 raft_consensus.cc:2454] T a7a385bf6e234317ad5c73b89171d7af P 1434e4845b084ea696de3d819fe57801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3169f35409af43e8a7029f17964d7f10 in term 1.
I20260811 11:45:22.968420 26862 leader_election.cc:302] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3169f35409af43e8a7029f17964d7f10, f4a56e37cfea4dd488fb0d02bbbd109c; no voters:
I20260811 11:45:22.968648 27025 raft_consensus.cc:2781] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:22.968858 27025 raft_consensus.cc:686] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10 [term 1 LEADER]: Becoming Leader. State: Replica: 3169f35409af43e8a7029f17964d7f10, State: Running, Role: LEADER
I20260811 11:45:22.969238 27025 consensus_queue.cc:237] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3169f35409af43e8a7029f17964d7f10" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35443 } } peers { permanent_uuid: "f4a56e37cfea4dd488fb0d02bbbd109c" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34111 } } peers { permanent_uuid: "1434e4845b084ea696de3d819fe57801" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 46675 } }
I20260811 11:45:22.972791 26453 catalog_manager.cc:5495] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3169f35409af43e8a7029f17964d7f10 (127.20.244.67). New cstate: current_term: 1 leader_uuid: "3169f35409af43e8a7029f17964d7f10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3169f35409af43e8a7029f17964d7f10" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4a56e37cfea4dd488fb0d02bbbd109c" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1434e4845b084ea696de3d819fe57801" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 46675 } health_report { overall_health: UNKNOWN } } }
I20260811 11:45:23.017931 27010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:23.013984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47352 (local address 127.20.244.67:35443)
0811 11:45:23.014159 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:23.014163 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:23.014180 (+ 17us) server_negotiation.cc:407] Connection header received
0811 11:45:23.014384 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:23.014387 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:23.014446 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:23.014563 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:45:23.014835 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:23.015420 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:23.016318 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:23.016631 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:23.016749 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:23.017075 (+ 326us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:45:23.017494 (+ 419us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:45:23.017629 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:23.017694 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 11:45:23.017753 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 11:45:23.024196 26779 raft_consensus.cc:1261] T a7a385bf6e234317ad5c73b89171d7af P 1434e4845b084ea696de3d819fe57801 [term 1 FOLLOWER]: Refusing update from remote peer 3169f35409af43e8a7029f17964d7f10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:23.024196 26624 raft_consensus.cc:1261] T a7a385bf6e234317ad5c73b89171d7af P f4a56e37cfea4dd488fb0d02bbbd109c [term 1 FOLLOWER]: Refusing update from remote peer 3169f35409af43e8a7029f17964d7f10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:23.024943 27025 consensus_queue.cc:1035] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a56e37cfea4dd488fb0d02bbbd109c" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:23.025153 27031 consensus_queue.cc:1035] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1434e4845b084ea696de3d819fe57801" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 46675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 11:45:23.029290 26997 tablet.cc:2369] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:45:23.033555 27035 mvcc.cc:205] Tried to move back new op lower bound from 7317293969499987968 to 7317293969285287936. Current Snapshot: MvccSnapshot[applied={T|T < 7317293969499987968}]
I20260811 11:45:23.036664 27036 mvcc.cc:205] Tried to move back new op lower bound from 7317293969499987968 to 7317293969285287936. Current Snapshot: MvccSnapshot[applied={T|T < 7317293969499987968 or (T in {7317293969499987968})}]
I20260811 11:45:23.042855 26453 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:23.043005 26453 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:23.045657 26453 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ad3d1200c68f4580a8ad3171be7dffd7: Sending DeleteTablet for 3 replicas of tablet a7a385bf6e234317ad5c73b89171d7af
I20260811 11:45:23.046602 26602 tablet_service.cc:1514] Processing DeleteTablet for tablet a7a385bf6e234317ad5c73b89171d7af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:23 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:48348
I20260811 11:45:23.046588 26755 tablet_service.cc:1514] Processing DeleteTablet for tablet a7a385bf6e234317ad5c73b89171d7af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:23 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:55848
I20260811 11:45:23.046620 26917 tablet_service.cc:1514] Processing DeleteTablet for tablet a7a385bf6e234317ad5c73b89171d7af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:23 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:47348
I20260811 11:45:23.047155 27046 tablet_replica.cc:330] T a7a385bf6e234317ad5c73b89171d7af P f4a56e37cfea4dd488fb0d02bbbd109c: stopping tablet replica
I20260811 11:45:23.047482 27046 raft_consensus.cc:2229] T a7a385bf6e234317ad5c73b89171d7af P f4a56e37cfea4dd488fb0d02bbbd109c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:23.047793 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 26525
I20260811 11:45:23.047817 27046 raft_consensus.cc:2258] T a7a385bf6e234317ad5c73b89171d7af P f4a56e37cfea4dd488fb0d02bbbd109c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:23.048156 27047 tablet_replica.cc:330] T a7a385bf6e234317ad5c73b89171d7af P 1434e4845b084ea696de3d819fe57801: stopping tablet replica
I20260811 11:45:23.048483 27044 tablet_replica.cc:330] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10: stopping tablet replica
I20260811 11:45:23.048725 27044 raft_consensus.cc:2229] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:45:23.049001 27044 raft_consensus.cc:2258] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:23.049301 27047 raft_consensus.cc:2229] T a7a385bf6e234317ad5c73b89171d7af P 1434e4845b084ea696de3d819fe57801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:23.049568 27047 raft_consensus.cc:2258] T a7a385bf6e234317ad5c73b89171d7af P 1434e4845b084ea696de3d819fe57801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:23.054838 27047 ts_tablet_manager.cc:1905] T a7a385bf6e234317ad5c73b89171d7af P 1434e4845b084ea696de3d819fe57801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:23.056442 27044 ts_tablet_manager.cc:1905] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:23.058000 27047 ts_tablet_manager.cc:1918] T a7a385bf6e234317ad5c73b89171d7af P 1434e4845b084ea696de3d819fe57801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:45:23.058106 27047 log.cc:1196] T a7a385bf6e234317ad5c73b89171d7af P 1434e4845b084ea696de3d819fe57801: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/a7a385bf6e234317ad5c73b89171d7af
I20260811 11:45:23.058483 27047 ts_tablet_manager.cc:1939] T a7a385bf6e234317ad5c73b89171d7af P 1434e4845b084ea696de3d819fe57801: Deleting consensus metadata
I20260811 11:45:23.059919 26434 catalog_manager.cc:4841] TS 1434e4845b084ea696de3d819fe57801 (127.20.244.66:46675): tablet a7a385bf6e234317ad5c73b89171d7af (table test-table [id=6f54e90f2f494debb7361b263597f4dc]) successfully deleted
I20260811 11:45:23.060200 27044 ts_tablet_manager.cc:1918] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:45:23.060310 27044 log.cc:1196] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/a7a385bf6e234317ad5c73b89171d7af
I20260811 11:45:23.060662 27044 ts_tablet_manager.cc:1939] T a7a385bf6e234317ad5c73b89171d7af P 3169f35409af43e8a7029f17964d7f10: Deleting consensus metadata
I20260811 11:45:23.061923 26434 catalog_manager.cc:4841] TS 3169f35409af43e8a7029f17964d7f10 (127.20.244.67:35443): tablet a7a385bf6e234317ad5c73b89171d7af (table test-table [id=6f54e90f2f494debb7361b263597f4dc]) successfully deleted
W20260811 11:45:23.062402 26437 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.244.65:34111 (error 108)
I20260811 11:45:23.062599 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 26680
I20260811 11:45:23.064651 27011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:23.064356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:34111 (local address 127.0.0.1:48354)
0811 11:45:23.064516 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:23.064574 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.65:34111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260811 11:45:23.064889 26437 catalog_manager.cc:4584] TS f4a56e37cfea4dd488fb0d02bbbd109c (127.20.244.65:34111): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a7a385bf6e234317ad5c73b89171d7af: Network error: Client connection negotiation failed: client connection to 127.20.244.65:34111: connect: Connection refused (error 111)
I20260811 11:45:23.073378 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 26843
I20260811 11:45:23.082304 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 26416
2026-08-11T11:45:23Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2617 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T11:45:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:45:23Z Disabled control of system clock
I20260811 11:45:23.118130 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:34975
--webserver_interface=127.20.244.126
--webserver_port=0
--builtin_ntp_servers=127.20.244.84:45117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:34975
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 11:45:23.229223 27052 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:23.229486 27052 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:23.229524 27052 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:23.233549 27052 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:23.233608 27052 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:23.233623 27052 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:23.233639 27052 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:23.233654 27052 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:45:23.238409 27052 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:45117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:34975
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:34975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27052
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:23.239539 27052 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:23.240892 27052 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:23.249816 27061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:23.249895 27058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:23.250038 27052 server_base.cc:1034] running on GCE node
W20260811 11:45:23.249857 27057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:23.250695 27052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:23.252025 27052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:23.253218 27052 hybrid_clock.cc:648] HybridClock initialized: now 1786448723253184 us; error 45 us; skew 500 ppm
I20260811 11:45:23.255299 27052 webserver.cc:460] Webserver started at http://127.20.244.126:41997/ using document root <none> and password file <none>
I20260811 11:45:23.255927 27052 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:23.255998 27052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:23.256258 27052 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:23.258460 27052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "7ea3776c005a4992967110f6d2b45f69"
format_stamp: "Formatted at 2026-08-11 11:45:23 on dist-test-slave-vkjp"
server_key: "bd680eb173959f717d0cf6ec56052127"
server_key_iv: "4ad1ae59312c041b0820fb334bf0e775"
server_key_version: "encryptionkey@0"
I20260811 11:45:23.259162 27052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "7ea3776c005a4992967110f6d2b45f69"
format_stamp: "Formatted at 2026-08-11 11:45:23 on dist-test-slave-vkjp"
server_key: "bd680eb173959f717d0cf6ec56052127"
server_key_iv: "4ad1ae59312c041b0820fb334bf0e775"
server_key_version: "encryptionkey@0"
I20260811 11:45:23.263137 27052 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 11:45:23.265686 27068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:23.266970 27052 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:23.267164 27052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "7ea3776c005a4992967110f6d2b45f69"
format_stamp: "Formatted at 2026-08-11 11:45:23 on dist-test-slave-vkjp"
server_key: "bd680eb173959f717d0cf6ec56052127"
server_key_iv: "4ad1ae59312c041b0820fb334bf0e775"
server_key_version: "encryptionkey@0"
I20260811 11:45:23.267297 27052 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:23.272475 27052 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:23.273151 27052 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:23.273357 27052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:23.281282 27052 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:34975
I20260811 11:45:23.281302 27127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:34975 every 8 connection(s)
I20260811 11:45:23.282557 27052 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:45:23.284093 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 27052
I20260811 11:45:23.284231 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:45:23.284559 21457 external_mini_cluster.cc:1428] Setting key 9742249b59bfb55b5726dcc67c2f0b0d
I20260811 11:45:23.286652 27128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:23.290856 27132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:23.286086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52610 (local address 127.20.244.126:34975)
0811 11:45:23.286847 (+ 761us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:23.286870 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:23.286911 (+ 41us) server_negotiation.cc:407] Connection header received
0811 11:45:23.287715 (+ 804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:23.287735 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:23.288105 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:23.288453 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:23.289384 (+ 931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:23.289389 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:23.289401 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:23.289414 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:23.289475 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:23.289495 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:23.289627 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:23.289761 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 11:45:23.290041 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":167,"threads_started":1}
I20260811 11:45:23.293120 27128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69: Bootstrap starting.
I20260811 11:45:23.295306 27128 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:23.296043 27128 log.cc:824] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:23.298029 27128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69: No bootstrap required, opened a new log
I20260811 11:45:23.301561 27128 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ea3776c005a4992967110f6d2b45f69" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34975 } }
I20260811 11:45:23.301807 27128 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:23.301899 27128 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ea3776c005a4992967110f6d2b45f69, State: Initialized, Role: FOLLOWER
I20260811 11:45:23.302363 27128 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ea3776c005a4992967110f6d2b45f69" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34975 } }
I20260811 11:45:23.302567 27128 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:45:23.302637 27128 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:45:23.302739 27128 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:23.303717 27128 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ea3776c005a4992967110f6d2b45f69" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34975 } }
I20260811 11:45:23.304062 27128 leader_election.cc:302] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ea3776c005a4992967110f6d2b45f69; no voters:
I20260811 11:45:23.304409 27128 leader_election.cc:288] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:45:23.304507 27135 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:23.304728 27135 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69 [term 1 LEADER]: Becoming Leader. State: Replica: 7ea3776c005a4992967110f6d2b45f69, State: Running, Role: LEADER
I20260811 11:45:23.305024 27135 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ea3776c005a4992967110f6d2b45f69" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34975 } }
I20260811 11:45:23.305737 27128 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:45:23.306811 27137 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ea3776c005a4992967110f6d2b45f69. Latest consensus state: current_term: 1 leader_uuid: "7ea3776c005a4992967110f6d2b45f69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ea3776c005a4992967110f6d2b45f69" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34975 } } }
I20260811 11:45:23.306948 27137 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:23.307241 27136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ea3776c005a4992967110f6d2b45f69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ea3776c005a4992967110f6d2b45f69" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34975 } } }
I20260811 11:45:23.307349 27136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:23.307638 27145 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:45:23.310716 27145 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:45:23.316604 27145 catalog_manager.cc:1347] Generated new cluster ID: b1015dd645fd4812985c6bae8e9c61b8
I20260811 11:45:23.316680 27145 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:45:23.344208 27145 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:45:23.344620 27145 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:45:23.350646 27145 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69: Generated new TSK 0
I20260811 11:45:23.351516 27145 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:45:23.357520 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:34975
--builtin_ntp_servers=127.20.244.84:45117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 11:45:23.475116 27157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:23.475411 27157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:23.475488 27157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:23.479511 27157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:23.479589 27157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:23.479681 27157 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:45:23.484467 27157 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:45117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:34975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:23.485677 27157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:23.487106 27157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:23.496713 27169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:23.496706 27166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:23.496703 27165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:23.496891 27157 server_base.cc:1034] running on GCE node
I20260811 11:45:23.497385 27157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:23.498023 27157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:23.499159 27157 hybrid_clock.cc:648] HybridClock initialized: now 1786448723499132 us; error 36 us; skew 500 ppm
I20260811 11:45:23.500870 27157 webserver.cc:460] Webserver started at http://127.20.244.65:37739/ using document root <none> and password file <none>
I20260811 11:45:23.501412 27157 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:23.501477 27157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:23.501641 27157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:23.503721 27157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "d3e0eaa95e844e6fb7248d5fd4649312"
format_stamp: "Formatted at 2026-08-11 11:45:23 on dist-test-slave-vkjp"
server_key: "f06a9b490f3ce01dac1572f78d9b75b5"
server_key_iv: "e823604342f20f1e5de1765538d87b4d"
server_key_version: "encryptionkey@0"
I20260811 11:45:23.504238 27157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "d3e0eaa95e844e6fb7248d5fd4649312"
format_stamp: "Formatted at 2026-08-11 11:45:23 on dist-test-slave-vkjp"
server_key: "f06a9b490f3ce01dac1572f78d9b75b5"
server_key_iv: "e823604342f20f1e5de1765538d87b4d"
server_key_version: "encryptionkey@0"
I20260811 11:45:23.508180 27157 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 11:45:23.510748 27177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:23.512115 27157 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:23.512254 27157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "d3e0eaa95e844e6fb7248d5fd4649312"
format_stamp: "Formatted at 2026-08-11 11:45:23 on dist-test-slave-vkjp"
server_key: "f06a9b490f3ce01dac1572f78d9b75b5"
server_key_iv: "e823604342f20f1e5de1765538d87b4d"
server_key_version: "encryptionkey@0"
I20260811 11:45:23.512388 27157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:23.518332 27157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:23.518888 27157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:23.519033 27157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:23.519582 27157 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:23.520538 27157 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:23.520596 27157 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:23.520637 27157 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:23.520651 27157 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:23.529455 27157 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:39667
I20260811 11:45:23.529491 27306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:39667 every 8 connection(s)
I20260811 11:45:23.530409 27157 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:45:23.535418 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 27157
I20260811 11:45:23.535583 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:45:23.535959 21457 external_mini_cluster.cc:1428] Setting key da40b1632516ca37863f58dda7b15f9f
I20260811 11:45:23.536830 27132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:23.532302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:45315 (local address 127.20.244.126:34975)
0811 11:45:23.532459 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:23.532463 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:23.533497 (+ 1034us) server_negotiation.cc:407] Connection header received
0811 11:45:23.534845 (+ 1348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:23.534848 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:23.534886 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:23.534952 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:23.536326 (+ 1374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:23.536329 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:23.536331 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:23.536343 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:23.536365 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:23.536373 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:23.536456 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:23.536642 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 11:45:23.536686 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 11:45:23.537943 27309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:23.532658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:34975 (local address 127.20.244.65:45315)
0811 11:45:23.533343 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:23.533385 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:23.534638 (+ 1253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:23.535183 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:23.535194 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:23.535367 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:23.535983 (+ 616us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:45:23.535986 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:23.536047 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:45:23.536149 (+ 102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:23.536470 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:23.536481 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:23.536488 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 11:45:23.536672 (+ 184us) client_negotiation.cc:240] Negotiation successful
0811 11:45:23.537019 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":119,"threads_started":1}
I20260811 11:45:23.538182 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:34975
--builtin_ntp_servers=127.20.244.84:45117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 11:45:23.539310 27307 heartbeater.cc:347] Connected to a master server at 127.20.244.126:34975
I20260811 11:45:23.539548 27307 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:23.540033 27307 heartbeater.cc:511] Master 127.20.244.126:34975 requested a full tablet report, sending...
I20260811 11:45:23.541661 27085 ts_manager.cc:194] Registered new tserver with Master: d3e0eaa95e844e6fb7248d5fd4649312 (127.20.244.65:39667)
W20260811 11:45:23.656984 27311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:23.657255 27311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:23.657339 27311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:23.661334 27311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:23.661389 27311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:23.661497 27311 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:45:23.666743 27311 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:45117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:34975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27311
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:23.667901 27311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:23.669292 27311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:23.678870 27321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:23.678930 27319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:23.678890 27316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:23.679164 27311 server_base.cc:1034] running on GCE node
I20260811 11:45:23.679652 27311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:23.680262 27311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:23.681465 27311 hybrid_clock.cc:648] HybridClock initialized: now 1786448723681447 us; error 36 us; skew 500 ppm
I20260811 11:45:23.683367 27311 webserver.cc:460] Webserver started at http://127.20.244.66:43341/ using document root <none> and password file <none>
I20260811 11:45:23.683940 27311 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:23.684033 27311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:23.684336 27311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:23.686353 27311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "08c0faadb96e4a1da75c166d842f6e8d"
format_stamp: "Formatted at 2026-08-11 11:45:23 on dist-test-slave-vkjp"
server_key: "9be1c4a443ac63e89961e7c67d91661f"
server_key_iv: "57facc83124608e450321648f2282231"
server_key_version: "encryptionkey@0"
I20260811 11:45:23.686926 27311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "08c0faadb96e4a1da75c166d842f6e8d"
format_stamp: "Formatted at 2026-08-11 11:45:23 on dist-test-slave-vkjp"
server_key: "9be1c4a443ac63e89961e7c67d91661f"
server_key_iv: "57facc83124608e450321648f2282231"
server_key_version: "encryptionkey@0"
I20260811 11:45:23.690656 27311 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260811 11:45:23.693120 27330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:23.694401 27311 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 11:45:23.694490 27311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "08c0faadb96e4a1da75c166d842f6e8d"
format_stamp: "Formatted at 2026-08-11 11:45:23 on dist-test-slave-vkjp"
server_key: "9be1c4a443ac63e89961e7c67d91661f"
server_key_iv: "57facc83124608e450321648f2282231"
server_key_version: "encryptionkey@0"
I20260811 11:45:23.694576 27311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:23.699002 27311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:23.699597 27311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:23.699730 27311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:23.700255 27311 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:23.701125 27311 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:23.701170 27311 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:23.701207 27311 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:23.701227 27311 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:23.710450 27311 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:35377
I20260811 11:45:23.710477 27461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:35377 every 8 connection(s)
I20260811 11:45:23.711380 27311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:45:23.715838 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 27311
I20260811 11:45:23.715974 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:45:23.716332 21457 external_mini_cluster.cc:1428] Setting key b1cbee8e698649c2b34bcdec57bb4c35
I20260811 11:45:23.717622 27132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:23.713150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:47767 (local address 127.20.244.126:34975)
0811 11:45:23.713290 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:23.713294 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:23.714324 (+ 1030us) server_negotiation.cc:407] Connection header received
0811 11:45:23.715598 (+ 1274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:23.715601 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:23.715638 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:23.715729 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:23.717090 (+ 1361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:23.717093 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:23.717095 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:23.717106 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:23.717126 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:23.717134 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:23.717242 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:23.717462 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 11:45:23.717500 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 11:45:23.718586 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:34975
--builtin_ntp_servers=127.20.244.84:45117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 11:45:23.718667 27466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:23.713532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:34975 (local address 127.20.244.66:47767)
0811 11:45:23.714172 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:23.714212 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:23.715397 (+ 1185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:23.715944 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:23.715956 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:23.716069 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:23.716780 (+ 711us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:45:23.716783 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:23.716840 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:45:23.716908 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:23.717300 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:23.717310 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:23.717316 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 11:45:23.717484 (+ 168us) client_negotiation.cc:240] Negotiation successful
0811 11:45:23.717864 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":115,"threads_started":1}
I20260811 11:45:23.719760 27463 heartbeater.cc:347] Connected to a master server at 127.20.244.126:34975
I20260811 11:45:23.720033 27463 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:23.720631 27463 heartbeater.cc:511] Master 127.20.244.126:34975 requested a full tablet report, sending...
I20260811 11:45:23.721755 27085 ts_manager.cc:194] Registered new tserver with Master: 08c0faadb96e4a1da75c166d842f6e8d (127.20.244.66:35377)
W20260811 11:45:23.835952 27467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:23.836225 27467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:23.836299 27467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:23.840435 27467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:23.840521 27467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:23.840611 27467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:45:23.845386 27467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:45117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:34975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:23.846670 27467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:23.848143 27467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:23.858124 27476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:23.858124 27474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:23.858140 27473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:23.858217 27467 server_base.cc:1034] running on GCE node
I20260811 11:45:23.858758 27467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:23.859467 27467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:23.860658 27467 hybrid_clock.cc:648] HybridClock initialized: now 1786448723860637 us; error 31 us; skew 500 ppm
I20260811 11:45:23.862499 27467 webserver.cc:460] Webserver started at http://127.20.244.67:46459/ using document root <none> and password file <none>
I20260811 11:45:23.863152 27467 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:23.863248 27467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:23.863492 27467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:23.865622 27467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "1d3f859d964f4f389aaf187a42b75826"
format_stamp: "Formatted at 2026-08-11 11:45:23 on dist-test-slave-vkjp"
server_key: "772f082fb2c1d98caeb2a2bc880aebb1"
server_key_iv: "2fd96de504cde91bcc55269b0d151c27"
server_key_version: "encryptionkey@0"
I20260811 11:45:23.866225 27467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "1d3f859d964f4f389aaf187a42b75826"
format_stamp: "Formatted at 2026-08-11 11:45:23 on dist-test-slave-vkjp"
server_key: "772f082fb2c1d98caeb2a2bc880aebb1"
server_key_iv: "2fd96de504cde91bcc55269b0d151c27"
server_key_version: "encryptionkey@0"
I20260811 11:45:23.869995 27467 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260811 11:45:23.872735 27484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:23.873944 27467 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 11:45:23.874091 27467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "1d3f859d964f4f389aaf187a42b75826"
format_stamp: "Formatted at 2026-08-11 11:45:23 on dist-test-slave-vkjp"
server_key: "772f082fb2c1d98caeb2a2bc880aebb1"
server_key_iv: "2fd96de504cde91bcc55269b0d151c27"
server_key_version: "encryptionkey@0"
I20260811 11:45:23.874213 27467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:23.879016 27467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:23.879649 27467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:23.879833 27467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:23.880371 27467 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:23.881318 27467 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:23.881390 27467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:23.881465 27467 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:23.881521 27467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:23.890818 27467 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:37299
I20260811 11:45:23.890846 27616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:37299 every 8 connection(s)
I20260811 11:45:23.891793 27467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:45:23.896868 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 27467
I20260811 11:45:23.897014 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:45:23.897416 21457 external_mini_cluster.cc:1428] Setting key 5d05220598ebf3a684988896a220c19b
I20260811 11:45:23.898542 27132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:23.893699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:54671 (local address 127.20.244.126:34975)
0811 11:45:23.893892 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:23.893895 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:23.894956 (+ 1061us) server_negotiation.cc:407] Connection header received
0811 11:45:23.896441 (+ 1485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:23.896444 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:23.896483 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:23.896562 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:23.898001 (+ 1439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:23.898005 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:23.898008 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:23.898021 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:23.898044 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:23.898061 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:23.898134 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:23.898341 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 11:45:23.898390 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260811 11:45:23.899757 27621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:23.894105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:34975 (local address 127.20.244.67:54671)
0811 11:45:23.894782 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:23.894842 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:23.896219 (+ 1377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:23.896829 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:23.896839 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:23.896969 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:23.897667 (+ 698us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:45:23.897669 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:23.897726 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:45:23.897848 (+ 122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:23.898152 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:23.898162 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:23.898169 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 11:45:23.898384 (+ 215us) client_negotiation.cc:240] Negotiation successful
0811 11:45:23.898642 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":110,"threads_started":1}
I20260811 11:45:23.900872 27617 heartbeater.cc:347] Connected to a master server at 127.20.244.126:34975
I20260811 11:45:23.901140 27617 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:23.901566 27617 heartbeater.cc:511] Master 127.20.244.126:34975 requested a full tablet report, sending...
I20260811 11:45:23.902603 27085 ts_manager.cc:194] Registered new tserver with Master: 1d3f859d964f4f389aaf187a42b75826 (127.20.244.67:37299)
I20260811 11:45:23.911782 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:45:23.915405 27132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:23.913841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52618 (local address 127.20.244.126:34975)
0811 11:45:23.913970 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:23.913973 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:23.914103 (+ 130us) server_negotiation.cc:407] Connection header received
0811 11:45:23.914192 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:23.914194 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:23.914228 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:23.914338 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:23.914998 (+ 660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:23.915001 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:23.915002 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:23.915013 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:23.915031 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:23.915039 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:23.915168 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:23.915233 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 11:45:23.915306 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 11:45:23.918356 27085 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52618:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:45:23.922210 27085 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:45:23.936702 27639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:23.933524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43794 (local address 127.20.244.66:35377)
0811 11:45:23.933933 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:23.933949 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:23.934665 (+ 716us) server_negotiation.cc:407] Connection header received
0811 11:45:23.934725 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:23.934730 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:23.934900 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:23.935041 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:23.936089 (+ 1048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:23.936100 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:23.936116 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:23.936132 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:23.936179 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:23.936215 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:23.936358 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:23.936484 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 11:45:23.936563 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":113,"threads_started":1}
I20260811 11:45:23.936691 27633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:23.933338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:35377 (local address 127.0.0.1:43794)
0811 11:45:23.934496 (+ 1158us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:23.934508 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:23.934571 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:23.935071 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:23.935096 (+ 25us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:23.935176 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:23.935863 (+ 687us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:45:23.935864 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:23.935885 (+ 21us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:45:23.935957 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:23.936343 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:23.936352 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:23.936358 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 11:45:23.936468 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 11:45:23.936539 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1099,"thread_start_us":93,"threads_started":1}
I20260811 11:45:23.937014 27638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:23.933401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35954 (local address 127.20.244.65:39667)
0811 11:45:23.933757 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:23.933769 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:23.933912 (+ 143us) server_negotiation.cc:407] Connection header received
0811 11:45:23.934057 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:23.934067 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:23.934274 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:23.934417 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:23.936126 (+ 1709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:23.936135 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:23.936150 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:23.936166 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:23.936210 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:23.936250 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:23.936360 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:23.936777 (+ 417us) server_negotiation.cc:299] Negotiation successful
0811 11:45:23.936842 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":657,"threads_started":1}
I20260811 11:45:23.936868 27637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:23.932738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:37299 (local address 127.0.0.1:57720)
0811 11:45:23.934128 (+ 1390us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:23.934138 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:23.934303 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:23.935375 (+ 1072us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:23.935381 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:23.935838 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:23.936232 (+ 394us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:45:23.936234 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:23.936244 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:45:23.936268 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:23.936663 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:23.936666 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:23.936669 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:45:23.936739 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 11:45:23.936771 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1339,"thread_start_us":87,"threads_started":1}
I20260811 11:45:23.937206 27636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:23.932905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57720 (local address 127.20.244.67:37299)
0811 11:45:23.933305 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:23.933319 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:23.934249 (+ 930us) server_negotiation.cc:407] Connection header received
0811 11:45:23.934416 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:23.934422 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:23.934600 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:23.934732 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:23.936402 (+ 1670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:23.936407 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:23.936417 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:23.936443 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:23.936488 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:23.936529 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:23.936623 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:23.936985 (+ 362us) server_negotiation.cc:299] Negotiation successful
0811 11:45:23.937055 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":177,"threads_started":1}
I20260811 11:45:23.936715 27635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:23.932592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:39667 (local address 127.0.0.1:35954)
0811 11:45:23.933776 (+ 1184us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:23.933831 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:23.933942 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:23.935158 (+ 1216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:23.935161 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:23.935175 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:23.935862 (+ 687us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:45:23.935864 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:23.935886 (+ 22us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:45:23.935957 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:23.936401 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:23.936403 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:23.936407 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:45:23.936481 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 11:45:23.936543 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":986,"thread_start_us":70,"threads_started":1}
I20260811 11:45:23.940128 27543 tablet_service.cc:1467] Processing CreateTablet for tablet ce6d597eb33f4fe494eb18e91a338498 (DEFAULT_TABLE table=test-table [id=a3304f0321a846d782c5db23ac2333c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:23.940241 27231 tablet_service.cc:1467] Processing CreateTablet for tablet ce6d597eb33f4fe494eb18e91a338498 (DEFAULT_TABLE table=test-table [id=a3304f0321a846d782c5db23ac2333c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:23.940243 27385 tablet_service.cc:1467] Processing CreateTablet for tablet ce6d597eb33f4fe494eb18e91a338498 (DEFAULT_TABLE table=test-table [id=a3304f0321a846d782c5db23ac2333c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:23.941349 27385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce6d597eb33f4fe494eb18e91a338498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:23.941349 27231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce6d597eb33f4fe494eb18e91a338498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:23.941365 27543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce6d597eb33f4fe494eb18e91a338498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:23.948189 27640 tablet_bootstrap.cc:492] T ce6d597eb33f4fe494eb18e91a338498 P 1d3f859d964f4f389aaf187a42b75826: Bootstrap starting.
I20260811 11:45:23.949518 27641 tablet_bootstrap.cc:492] T ce6d597eb33f4fe494eb18e91a338498 P d3e0eaa95e844e6fb7248d5fd4649312: Bootstrap starting.
I20260811 11:45:23.949867 27642 tablet_bootstrap.cc:492] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d: Bootstrap starting.
I20260811 11:45:23.951154 27640 tablet_bootstrap.cc:654] T ce6d597eb33f4fe494eb18e91a338498 P 1d3f859d964f4f389aaf187a42b75826: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:23.951746 27642 tablet_bootstrap.cc:654] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:23.951758 27641 tablet_bootstrap.cc:654] T ce6d597eb33f4fe494eb18e91a338498 P d3e0eaa95e844e6fb7248d5fd4649312: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:23.952143 27640 log.cc:824] T ce6d597eb33f4fe494eb18e91a338498 P 1d3f859d964f4f389aaf187a42b75826: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:23.952677 27642 log.cc:824] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:23.952884 27641 log.cc:824] T ce6d597eb33f4fe494eb18e91a338498 P d3e0eaa95e844e6fb7248d5fd4649312: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:23.954351 27640 tablet_bootstrap.cc:492] T ce6d597eb33f4fe494eb18e91a338498 P 1d3f859d964f4f389aaf187a42b75826: No bootstrap required, opened a new log
I20260811 11:45:23.954587 27640 ts_tablet_manager.cc:1397] T ce6d597eb33f4fe494eb18e91a338498 P 1d3f859d964f4f389aaf187a42b75826: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 11:45:23.954788 27641 tablet_bootstrap.cc:492] T ce6d597eb33f4fe494eb18e91a338498 P d3e0eaa95e844e6fb7248d5fd4649312: No bootstrap required, opened a new log
I20260811 11:45:23.954964 27641 ts_tablet_manager.cc:1397] T ce6d597eb33f4fe494eb18e91a338498 P d3e0eaa95e844e6fb7248d5fd4649312: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 11:45:23.958410 27641 raft_consensus.cc:348] T ce6d597eb33f4fe494eb18e91a338498 P d3e0eaa95e844e6fb7248d5fd4649312 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3e0eaa95e844e6fb7248d5fd4649312" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39667 } } peers { permanent_uuid: "1d3f859d964f4f389aaf187a42b75826" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 37299 } } peers { permanent_uuid: "08c0faadb96e4a1da75c166d842f6e8d" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35377 } }
I20260811 11:45:23.958626 27641 raft_consensus.cc:374] T ce6d597eb33f4fe494eb18e91a338498 P d3e0eaa95e844e6fb7248d5fd4649312 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:23.958658 27641 raft_consensus.cc:729] T ce6d597eb33f4fe494eb18e91a338498 P d3e0eaa95e844e6fb7248d5fd4649312 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3e0eaa95e844e6fb7248d5fd4649312, State: Initialized, Role: FOLLOWER
I20260811 11:45:23.958528 27640 raft_consensus.cc:348] T ce6d597eb33f4fe494eb18e91a338498 P 1d3f859d964f4f389aaf187a42b75826 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3e0eaa95e844e6fb7248d5fd4649312" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39667 } } peers { permanent_uuid: "1d3f859d964f4f389aaf187a42b75826" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 37299 } } peers { permanent_uuid: "08c0faadb96e4a1da75c166d842f6e8d" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35377 } }
I20260811 11:45:23.958926 27640 raft_consensus.cc:374] T ce6d597eb33f4fe494eb18e91a338498 P 1d3f859d964f4f389aaf187a42b75826 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:23.959021 27640 raft_consensus.cc:729] T ce6d597eb33f4fe494eb18e91a338498 P 1d3f859d964f4f389aaf187a42b75826 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d3f859d964f4f389aaf187a42b75826, State: Initialized, Role: FOLLOWER
I20260811 11:45:23.959183 27641 consensus_queue.cc:260] T ce6d597eb33f4fe494eb18e91a338498 P d3e0eaa95e844e6fb7248d5fd4649312 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3e0eaa95e844e6fb7248d5fd4649312" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39667 } } peers { permanent_uuid: "1d3f859d964f4f389aaf187a42b75826" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 37299 } } peers { permanent_uuid: "08c0faadb96e4a1da75c166d842f6e8d" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35377 } }
I20260811 11:45:23.959671 27640 consensus_queue.cc:260] T ce6d597eb33f4fe494eb18e91a338498 P 1d3f859d964f4f389aaf187a42b75826 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3e0eaa95e844e6fb7248d5fd4649312" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39667 } } peers { permanent_uuid: "1d3f859d964f4f389aaf187a42b75826" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 37299 } } peers { permanent_uuid: "08c0faadb96e4a1da75c166d842f6e8d" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35377 } }
I20260811 11:45:23.960199 27641 ts_tablet_manager.cc:1428] T ce6d597eb33f4fe494eb18e91a338498 P d3e0eaa95e844e6fb7248d5fd4649312: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 11:45:23.960354 27642 tablet_bootstrap.cc:492] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d: No bootstrap required, opened a new log
I20260811 11:45:23.960350 27617 heartbeater.cc:503] Master 127.20.244.126:34975 was elected leader, sending a full tablet report...
I20260811 11:45:23.960522 27642 ts_tablet_manager.cc:1397] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260811 11:45:23.960528 27307 heartbeater.cc:503] Master 127.20.244.126:34975 was elected leader, sending a full tablet report...
I20260811 11:45:23.960623 27640 ts_tablet_manager.cc:1428] T ce6d597eb33f4fe494eb18e91a338498 P 1d3f859d964f4f389aaf187a42b75826: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260811 11:45:23.965152 27642 raft_consensus.cc:348] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3e0eaa95e844e6fb7248d5fd4649312" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39667 } } peers { permanent_uuid: "1d3f859d964f4f389aaf187a42b75826" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 37299 } } peers { permanent_uuid: "08c0faadb96e4a1da75c166d842f6e8d" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35377 } }
I20260811 11:45:23.965436 27642 raft_consensus.cc:374] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:23.965503 27642 raft_consensus.cc:729] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08c0faadb96e4a1da75c166d842f6e8d, State: Initialized, Role: FOLLOWER
I20260811 11:45:23.965907 27642 consensus_queue.cc:260] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3e0eaa95e844e6fb7248d5fd4649312" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39667 } } peers { permanent_uuid: "1d3f859d964f4f389aaf187a42b75826" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 37299 } } peers { permanent_uuid: "08c0faadb96e4a1da75c166d842f6e8d" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35377 } }
I20260811 11:45:23.966545 27463 heartbeater.cc:503] Master 127.20.244.126:34975 was elected leader, sending a full tablet report...
I20260811 11:45:23.966683 27642 ts_tablet_manager.cc:1428] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
W20260811 11:45:24.031625 27308 tablet.cc:2369] T ce6d597eb33f4fe494eb18e91a338498 P d3e0eaa95e844e6fb7248d5fd4649312: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:45:24.128559 27651 raft_consensus.cc:482] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:45:24.128793 27651 raft_consensus.cc:504] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3e0eaa95e844e6fb7248d5fd4649312" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39667 } } peers { permanent_uuid: "1d3f859d964f4f389aaf187a42b75826" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 37299 } } peers { permanent_uuid: "08c0faadb96e4a1da75c166d842f6e8d" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35377 } }
I20260811 11:45:24.130043 27651 leader_election.cc:288] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3e0eaa95e844e6fb7248d5fd4649312 (127.20.244.65:39667), 1d3f859d964f4f389aaf187a42b75826 (127.20.244.67:37299)
I20260811 11:45:24.132021 27466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:24.130242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:39667 (local address 127.20.244.66:55605)
0811 11:45:24.130386 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:24.130405 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:24.130495 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:24.130781 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:24.130784 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:24.130801 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:24.131394 (+ 593us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:45:24.131397 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:24.131410 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:45:24.131444 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:24.131736 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:24.131738 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:24.131741 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:45:24.131843 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 11:45:24.131884 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 11:45:24.132021 27638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:24.130383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:55605 (local address 127.20.244.65:39667)
0811 11:45:24.130529 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:24.130533 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:24.130549 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:45:24.130599 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:24.130602 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:24.130641 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:24.130737 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:24.131579 (+ 842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:24.131583 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:24.131585 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:24.131599 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:24.131624 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:24.131639 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:24.131742 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:24.131863 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 11:45:24.131908 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 11:45:24.132776 27652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:24.130349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:37299 (local address 127.20.244.66:45943)
0811 11:45:24.130739 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:24.130754 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:24.130845 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:24.131159 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:24.131162 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:24.131176 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:24.131872 (+ 696us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:45:24.131877 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:24.131890 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:45:24.131932 (+ 42us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:24.132535 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:24.132538 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:24.132540 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 11:45:24.132611 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 11:45:24.132645 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":153,"threads_started":1}
I20260811 11:45:24.132730 27256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce6d597eb33f4fe494eb18e91a338498" candidate_uuid: "08c0faadb96e4a1da75c166d842f6e8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3e0eaa95e844e6fb7248d5fd4649312" is_pre_election: true
I20260811 11:45:24.132819 27636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:24.130542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:45943 (local address 127.20.244.67:37299)
0811 11:45:24.130655 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:24.130658 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:24.130851 (+ 193us) server_negotiation.cc:407] Connection header received
0811 11:45:24.130940 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:24.130942 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:24.131005 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:24.131126 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:24.132337 (+ 1211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:24.132344 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:24.132349 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:24.132367 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:24.132390 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:24.132399 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:24.132464 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:24.132647 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 11:45:24.132691 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 11:45:24.133037 27256 raft_consensus.cc:2454] T ce6d597eb33f4fe494eb18e91a338498 P d3e0eaa95e844e6fb7248d5fd4649312 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08c0faadb96e4a1da75c166d842f6e8d in term 0.
I20260811 11:45:24.139874 27332 leader_election.cc:302] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08c0faadb96e4a1da75c166d842f6e8d, d3e0eaa95e844e6fb7248d5fd4649312; no voters:
I20260811 11:45:24.140802 27651 raft_consensus.cc:2781] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:45:24.140920 27651 raft_consensus.cc:482] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:45:24.140980 27651 raft_consensus.cc:3037] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:24.141330 27568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce6d597eb33f4fe494eb18e91a338498" candidate_uuid: "08c0faadb96e4a1da75c166d842f6e8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d3f859d964f4f389aaf187a42b75826" is_pre_election: true
I20260811 11:45:24.141606 27568 raft_consensus.cc:2454] T ce6d597eb33f4fe494eb18e91a338498 P 1d3f859d964f4f389aaf187a42b75826 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08c0faadb96e4a1da75c166d842f6e8d in term 0.
W20260811 11:45:24.142660 27620 tablet.cc:2369] T ce6d597eb33f4fe494eb18e91a338498 P 1d3f859d964f4f389aaf187a42b75826: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:45:24.143702 27651 raft_consensus.cc:504] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3e0eaa95e844e6fb7248d5fd4649312" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39667 } } peers { permanent_uuid: "1d3f859d964f4f389aaf187a42b75826" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 37299 } } peers { permanent_uuid: "08c0faadb96e4a1da75c166d842f6e8d" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35377 } }
I20260811 11:45:24.144244 27651 leader_election.cc:288] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d [CANDIDATE]: Term 1 election: Requested vote from peers d3e0eaa95e844e6fb7248d5fd4649312 (127.20.244.65:39667), 1d3f859d964f4f389aaf187a42b75826 (127.20.244.67:37299)
I20260811 11:45:24.144600 27568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce6d597eb33f4fe494eb18e91a338498" candidate_uuid: "08c0faadb96e4a1da75c166d842f6e8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d3f859d964f4f389aaf187a42b75826"
I20260811 11:45:24.144634 27256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce6d597eb33f4fe494eb18e91a338498" candidate_uuid: "08c0faadb96e4a1da75c166d842f6e8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3e0eaa95e844e6fb7248d5fd4649312"
I20260811 11:45:24.144784 27256 raft_consensus.cc:3037] T ce6d597eb33f4fe494eb18e91a338498 P d3e0eaa95e844e6fb7248d5fd4649312 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:24.144740 27568 raft_consensus.cc:3037] T ce6d597eb33f4fe494eb18e91a338498 P 1d3f859d964f4f389aaf187a42b75826 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:24.145848 27256 raft_consensus.cc:2454] T ce6d597eb33f4fe494eb18e91a338498 P d3e0eaa95e844e6fb7248d5fd4649312 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08c0faadb96e4a1da75c166d842f6e8d in term 1.
I20260811 11:45:24.146199 27332 leader_election.cc:302] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08c0faadb96e4a1da75c166d842f6e8d, d3e0eaa95e844e6fb7248d5fd4649312; no voters:
I20260811 11:45:24.146687 27568 raft_consensus.cc:2454] T ce6d597eb33f4fe494eb18e91a338498 P 1d3f859d964f4f389aaf187a42b75826 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08c0faadb96e4a1da75c166d842f6e8d in term 1.
I20260811 11:45:24.146970 27651 raft_consensus.cc:2781] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:24.147303 27651 raft_consensus.cc:686] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d [term 1 LEADER]: Becoming Leader. State: Replica: 08c0faadb96e4a1da75c166d842f6e8d, State: Running, Role: LEADER
I20260811 11:45:24.148068 27651 consensus_queue.cc:237] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3e0eaa95e844e6fb7248d5fd4649312" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39667 } } peers { permanent_uuid: "1d3f859d964f4f389aaf187a42b75826" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 37299 } } peers { permanent_uuid: "08c0faadb96e4a1da75c166d842f6e8d" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35377 } }
I20260811 11:45:24.152448 27085 catalog_manager.cc:5495] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d reported cstate change: term changed from 0 to 1, leader changed from <none> to 08c0faadb96e4a1da75c166d842f6e8d (127.20.244.66). New cstate: current_term: 1 leader_uuid: "08c0faadb96e4a1da75c166d842f6e8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3e0eaa95e844e6fb7248d5fd4649312" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d3f859d964f4f389aaf187a42b75826" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 37299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08c0faadb96e4a1da75c166d842f6e8d" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35377 } health_report { overall_health: HEALTHY } } }
I20260811 11:45:24.174564 27639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:24.172751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43802 (local address 127.20.244.66:35377)
0811 11:45:24.172895 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:24.172900 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:24.173009 (+ 109us) server_negotiation.cc:407] Connection header received
0811 11:45:24.173208 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:24.173211 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:24.173283 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:24.173378 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:24.174128 (+ 750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:24.174132 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:24.174135 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:24.174149 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:24.174172 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:24.174190 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:24.174287 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:24.174360 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 11:45:24.174405 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 11:45:24.181288 27256 raft_consensus.cc:1261] T ce6d597eb33f4fe494eb18e91a338498 P d3e0eaa95e844e6fb7248d5fd4649312 [term 1 FOLLOWER]: Refusing update from remote peer 08c0faadb96e4a1da75c166d842f6e8d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:24.181398 27568 raft_consensus.cc:1261] T ce6d597eb33f4fe494eb18e91a338498 P 1d3f859d964f4f389aaf187a42b75826 [term 1 FOLLOWER]: Refusing update from remote peer 08c0faadb96e4a1da75c166d842f6e8d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:24.182152 27651 consensus_queue.cc:1035] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3e0eaa95e844e6fb7248d5fd4649312" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 39667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:24.182353 27655 consensus_queue.cc:1035] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d3f859d964f4f389aaf187a42b75826" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 37299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:24.191216 27661 mvcc.cc:205] Tried to move back new op lower bound from 7317293974237478912 to 7317293974114426880. Current Snapshot: MvccSnapshot[applied={T|T < 7317293974237478912}]
I20260811 11:45:24.202665 27085 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52618:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:24.202847 27085 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52618:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:24.205686 27085 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7ea3776c005a4992967110f6d2b45f69: Sending DeleteTablet for 3 replicas of tablet ce6d597eb33f4fe494eb18e91a338498
I20260811 11:45:24.206729 27543 tablet_service.cc:1514] Processing DeleteTablet for tablet ce6d597eb33f4fe494eb18e91a338498 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:24 UTC) from {username='slave'} at 127.0.0.1:57720
I20260811 11:45:24.207381 27668 tablet_replica.cc:330] T ce6d597eb33f4fe494eb18e91a338498 P 1d3f859d964f4f389aaf187a42b75826: stopping tablet replica
I20260811 11:45:24.207471 27231 tablet_service.cc:1514] Processing DeleteTablet for tablet ce6d597eb33f4fe494eb18e91a338498 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:24 UTC) from {username='slave'} at 127.0.0.1:35954
I20260811 11:45:24.207945 27668 raft_consensus.cc:2229] T ce6d597eb33f4fe494eb18e91a338498 P 1d3f859d964f4f389aaf187a42b75826 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:24.208323 27668 raft_consensus.cc:2258] T ce6d597eb33f4fe494eb18e91a338498 P 1d3f859d964f4f389aaf187a42b75826 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:24.208608 27385 tablet_service.cc:1514] Processing DeleteTablet for tablet ce6d597eb33f4fe494eb18e91a338498 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:24 UTC) from {username='slave'} at 127.0.0.1:43794
I20260811 11:45:24.208817 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 27157
I20260811 11:45:24.211908 27668 ts_tablet_manager.cc:1905] T ce6d597eb33f4fe494eb18e91a338498 P 1d3f859d964f4f389aaf187a42b75826: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:24.214915 27668 ts_tablet_manager.cc:1918] T ce6d597eb33f4fe494eb18e91a338498 P 1d3f859d964f4f389aaf187a42b75826: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:45:24.215116 27668 log.cc:1196] T ce6d597eb33f4fe494eb18e91a338498 P 1d3f859d964f4f389aaf187a42b75826: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/ce6d597eb33f4fe494eb18e91a338498
I20260811 11:45:24.215564 27668 ts_tablet_manager.cc:1939] T ce6d597eb33f4fe494eb18e91a338498 P 1d3f859d964f4f389aaf187a42b75826: Deleting consensus metadata
I20260811 11:45:24.216943 27071 catalog_manager.cc:4841] TS 1d3f859d964f4f389aaf187a42b75826 (127.20.244.67:37299): tablet ce6d597eb33f4fe494eb18e91a338498 (table test-table [id=a3304f0321a846d782c5db23ac2333c5]) successfully deleted
I20260811 11:45:24.219331 27670 tablet_replica.cc:330] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d: stopping tablet replica
I20260811 11:45:24.219753 27670 raft_consensus.cc:2229] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:45:24.220222 27670 raft_consensus.cc:2258] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:24.221921 27670 ts_tablet_manager.cc:1905] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 11:45:24.223901 27070 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.244.65:39667 (error 108)
I20260811 11:45:24.224856 27670 ts_tablet_manager.cc:1918] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:45:24.225039 27670 log.cc:1196] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/ce6d597eb33f4fe494eb18e91a338498
I20260811 11:45:24.225447 27670 ts_tablet_manager.cc:1939] T ce6d597eb33f4fe494eb18e91a338498 P 08c0faadb96e4a1da75c166d842f6e8d: Deleting consensus metadata
I20260811 11:45:24.225710 27635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:24.225294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:39667 (local address 127.0.0.1:35958)
0811 11:45:24.225517 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:24.225598 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.65:39667: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
W20260811 11:45:24.225903 27070 catalog_manager.cc:4584] TS d3e0eaa95e844e6fb7248d5fd4649312 (127.20.244.65:39667): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ce6d597eb33f4fe494eb18e91a338498: Network error: Client connection negotiation failed: client connection to 127.20.244.65:39667: connect: Connection refused (error 111)
I20260811 11:45:24.226275 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 27311
I20260811 11:45:24.238209 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 27467
I20260811 11:45:24.240113 27635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:24.238379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:35377 (local address 127.0.0.1:43806)
0811 11:45:24.239893 (+ 1514us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:24.239988 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.66:35377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1375}
I20260811 11:45:24.246577 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 27052
2026-08-11T11:45:24Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1162 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 11:45:24.271979 21457 mini_oidc.cc:152] Starting JWKS server
I20260811 11:45:24.273707 21457 webserver.cc:460] Webserver started at https://127.0.0.1:37901/ using document root <none> and password file <none>
I20260811 11:45:24.273844 21457 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 11:45:24.274061 21457 webserver.cc:460] Webserver started at http://127.0.0.1:38627/ using document root <none> and password file <none>
2026-08-11T11:45:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:45:24Z Disabled control of system clock
I20260811 11:45:24.284782 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:45889
--webserver_interface=127.20.244.126
--webserver_port=0
--builtin_ntp_servers=127.20.244.84:37171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:45889
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37901/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786448696706302-21457-0/testchainca.cert with env {}
W20260811 11:45:24.398149 27679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:24.398406 27679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:24.398451 27679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:24.402504 27679 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:24.402561 27679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:24.402577 27679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:24.402594 27679 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:24.402609 27679 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 11:45:24.402624 27679 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 11:45:24.402681 27679 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37901/jwks.json
I20260811 11:45:24.407948 27679 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:45889
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:45889
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37901/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786448696706302-21457-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27679
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:24.408973 27679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:24.409997 27679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:24.418426 27686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:24.418496 27679 server_base.cc:1034] running on GCE node
W20260811 11:45:24.418529 27685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:24.418674 27689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:24.419348 27679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:24.420356 27679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:24.421535 27679 hybrid_clock.cc:648] HybridClock initialized: now 1786448724421496 us; error 29 us; skew 500 ppm
I20260811 11:45:24.423533 27679 webserver.cc:460] Webserver started at http://127.20.244.126:46205/ using document root <none> and password file <none>
I20260811 11:45:24.424113 27679 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:24.424175 27679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:24.424408 27679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:24.426437 27679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "9a2c024f432f4bf1a3fa568579ac5168"
format_stamp: "Formatted at 2026-08-11 11:45:24 on dist-test-slave-vkjp"
server_key: "43ddc9f0a31488f2074af43b03493c1d"
server_key_iv: "afba0d5e61a72cf03457381b5ccd1897"
server_key_version: "encryptionkey@0"
I20260811 11:45:24.427017 27679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "9a2c024f432f4bf1a3fa568579ac5168"
format_stamp: "Formatted at 2026-08-11 11:45:24 on dist-test-slave-vkjp"
server_key: "43ddc9f0a31488f2074af43b03493c1d"
server_key_iv: "afba0d5e61a72cf03457381b5ccd1897"
server_key_version: "encryptionkey@0"
I20260811 11:45:24.430635 27679 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:45:24.433139 27697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:24.434438 27679 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:24.434579 27679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "9a2c024f432f4bf1a3fa568579ac5168"
format_stamp: "Formatted at 2026-08-11 11:45:24 on dist-test-slave-vkjp"
server_key: "43ddc9f0a31488f2074af43b03493c1d"
server_key_iv: "afba0d5e61a72cf03457381b5ccd1897"
server_key_version: "encryptionkey@0"
I20260811 11:45:24.434693 27679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:24.451793 27679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:24.452450 27679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:24.452648 27679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:24.460041 27679 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:45889
I20260811 11:45:24.460088 27756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:45889 every 8 connection(s)
I20260811 11:45:24.461027 27679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:45:24.464324 27757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:24.469741 27757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168: Bootstrap starting.
I20260811 11:45:24.471261 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 27679
I20260811 11:45:24.471379 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:45:24.471664 21457 external_mini_cluster.cc:1428] Setting key 69f7e3da893ea2d82d60de1129631637
I20260811 11:45:24.472465 27757 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:24.473330 27757 log.cc:824] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:24.475617 27757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168: No bootstrap required, opened a new log
I20260811 11:45:24.479940 27757 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a2c024f432f4bf1a3fa568579ac5168" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45889 } }
I20260811 11:45:24.480201 27757 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:24.480269 27757 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a2c024f432f4bf1a3fa568579ac5168, State: Initialized, Role: FOLLOWER
I20260811 11:45:24.480772 27757 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a2c024f432f4bf1a3fa568579ac5168" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45889 } }
I20260811 11:45:24.480931 27757 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:45:24.481019 27757 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:45:24.481115 27757 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:24.482002 27761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:24.472797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54094 (local address 127.20.244.126:45889)
0811 11:45:24.473544 (+ 747us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:24.473564 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:24.473608 (+ 44us) server_negotiation.cc:407] Connection header received
0811 11:45:24.474491 (+ 883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:24.474514 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:24.474928 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:24.475318 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:24.475749 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:24.477223 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:24.478109 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:24.478872 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:24.479075 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:24.479889 (+ 814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:24.479895 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:24.479909 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:24.480420 (+ 511us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:24.480488 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:24.480514 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:24.480612 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:24.480756 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 11:45:24.481046 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":139,"threads_started":1}
I20260811 11:45:24.482209 27757 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a2c024f432f4bf1a3fa568579ac5168" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45889 } }
I20260811 11:45:24.482523 27757 leader_election.cc:302] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a2c024f432f4bf1a3fa568579ac5168; no voters:
I20260811 11:45:24.482831 27757 leader_election.cc:288] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:45:24.482959 27763 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:24.483215 27763 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168 [term 1 LEADER]: Becoming Leader. State: Replica: 9a2c024f432f4bf1a3fa568579ac5168, State: Running, Role: LEADER
I20260811 11:45:24.483498 27763 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a2c024f432f4bf1a3fa568579ac5168" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45889 } }
I20260811 11:45:24.484124 27757 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:45:24.484968 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:45:24.485292 27767 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a2c024f432f4bf1a3fa568579ac5168" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a2c024f432f4bf1a3fa568579ac5168" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45889 } } }
I20260811 11:45:24.485397 27767 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:24.485810 27768 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a2c024f432f4bf1a3fa568579ac5168. Latest consensus state: current_term: 1 leader_uuid: "9a2c024f432f4bf1a3fa568579ac5168" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a2c024f432f4bf1a3fa568579ac5168" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45889 } } }
I20260811 11:45:24.486546 27768 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168 [sys.catalog]: This master's current role is: LEADER
W20260811 11:45:24.488883 27785 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:45:24.488948 27785 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:45:24.489029 27777 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:45:24.489693 27777 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:45:24.495460 27777 catalog_manager.cc:1347] Generated new cluster ID: c79d8a31d77249549008d3e334f78633
I20260811 11:45:24.495527 27777 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:45:24.512430 27777 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:45:24.513362 27777 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:45:24.522500 27777 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9a2c024f432f4bf1a3fa568579ac5168: Generated new TSK 0
I20260811 11:45:24.523249 27777 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 11:45:24.555048 27795 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 11:45:24.555212 27795 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 11:45:24.555882 27761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:24.535822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54110 (local address 127.20.244.126:45889)
0811 11:45:24.535969 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:24.535974 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:24.536148 (+ 174us) server_negotiation.cc:407] Connection header received
0811 11:45:24.536333 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:24.536336 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:24.536392 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:24.536497 (+ 105us) server_negotiation.cc:226] Negotiated authn=JWT
0811 11:45:24.536746 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:24.537606 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:24.538513 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:24.538858 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:24.538974 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:24.539316 (+ 342us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 11:45:24.555474 (+ 16158us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37901/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 11:45:24.555742 (+ 268us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54110: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37901/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":53}
W20260811 11:45:24.555982 27761 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54110: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37901/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 11:45:24.557229 27793 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:24.535711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:45889 (local address 127.0.0.1:54110)
0811 11:45:24.536060 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:24.536076 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:24.536183 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:24.536525 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:24.536527 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:24.536534 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0811 11:45:24.536643 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:24.536647 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:24.537727 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:24.537730 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:24.538401 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:24.538413 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:24.538977 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:24.538981 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:24.539049 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:24.539138 (+ 89us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 11:45:24.555730 (+ 16592us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37901/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 11:45:24.555976 (+ 246us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.244.126:45889: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37901/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":114,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.20.244.126:45889: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37901/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 11:45:24.558122 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 27679
2026-08-11T11:45:24Z chronyd exiting
I20260811 11:45:24.600145 21457 test_util.cc:175] -----------------------------------------------
I20260811 11:45:24.600253 21457 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786448696706302-21457-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (330 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 11:45:24.601459 21457 mini_oidc.cc:152] Starting JWKS server
I20260811 11:45:24.602334 21457 webserver.cc:460] Webserver started at https://127.0.0.1:36267/ using document root <none> and password file <none>
I20260811 11:45:24.602463 21457 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 11:45:24.602766 21457 webserver.cc:460] Webserver started at http://127.0.0.1:41975/ using document root <none> and password file <none>
2026-08-11T11:45:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:45:24Z Disabled control of system clock
I20260811 11:45:24.613505 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:37775
--webserver_interface=127.20.244.126
--webserver_port=0
--builtin_ntp_servers=127.20.244.84:42651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:37775
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36267/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786448696706302-21457-0/testchainca.cert with env {}
W20260811 11:45:24.726298 27802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:24.726593 27802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:24.726637 27802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:24.730641 27802 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:24.730702 27802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:24.730718 27802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:24.730736 27802 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:24.730751 27802 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 11:45:24.730773 27802 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 11:45:24.730786 27802 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36267/jwks.json
I20260811 11:45:24.736171 27802 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:42651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:37775
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:37775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36267/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786448696706302-21457-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27802
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:24.737190 27802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:24.738153 27802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:24.746722 27809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:24.746722 27810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:24.746841 27802 server_base.cc:1034] running on GCE node
W20260811 11:45:24.746991 27812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:24.747594 27802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:24.748592 27802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:24.749788 27802 hybrid_clock.cc:648] HybridClock initialized: now 1786448724749771 us; error 25 us; skew 500 ppm
I20260811 11:45:24.751626 27802 webserver.cc:460] Webserver started at http://127.20.244.126:46635/ using document root <none> and password file <none>
I20260811 11:45:24.752218 27802 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:24.752279 27802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:24.752533 27802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:24.754526 27802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "9e825c4476c64dbca903c17c7158b86c"
format_stamp: "Formatted at 2026-08-11 11:45:24 on dist-test-slave-vkjp"
server_key: "b8534996f8e0d5b47be71b400193cb87"
server_key_iv: "69d2577226a619af2acee8f775012b31"
server_key_version: "encryptionkey@0"
I20260811 11:45:24.755156 27802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "9e825c4476c64dbca903c17c7158b86c"
format_stamp: "Formatted at 2026-08-11 11:45:24 on dist-test-slave-vkjp"
server_key: "b8534996f8e0d5b47be71b400193cb87"
server_key_iv: "69d2577226a619af2acee8f775012b31"
server_key_version: "encryptionkey@0"
I20260811 11:45:24.758728 27802 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 11:45:24.761127 27821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:24.762337 27802 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:24.762435 27802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "9e825c4476c64dbca903c17c7158b86c"
format_stamp: "Formatted at 2026-08-11 11:45:24 on dist-test-slave-vkjp"
server_key: "b8534996f8e0d5b47be71b400193cb87"
server_key_iv: "69d2577226a619af2acee8f775012b31"
server_key_version: "encryptionkey@0"
I20260811 11:45:24.762519 27802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:24.791667 27802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:24.792357 27802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:24.792511 27802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:24.799688 27802 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:37775
I20260811 11:45:24.799712 27881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:37775 every 8 connection(s)
I20260811 11:45:24.800657 27802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:45:24.804025 27882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:24.809571 27882 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c: Bootstrap starting.
I20260811 11:45:24.809824 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 27802
I20260811 11:45:24.809947 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:45:24.810213 21457 external_mini_cluster.cc:1428] Setting key 927963bcd2caff9e51cd316a2bb9e1ad
I20260811 11:45:24.812408 27882 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:24.813325 27882 log.cc:824] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:24.815565 27882 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c: No bootstrap required, opened a new log
I20260811 11:45:24.820230 27882 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e825c4476c64dbca903c17c7158b86c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37775 } }
I20260811 11:45:24.820504 27882 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:24.820564 27882 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e825c4476c64dbca903c17c7158b86c, State: Initialized, Role: FOLLOWER
I20260811 11:45:24.821067 27882 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e825c4476c64dbca903c17c7158b86c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37775 } }
I20260811 11:45:24.821285 27882 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:45:24.821358 27882 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:45:24.821362 27885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:24.811571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45372 (local address 127.20.244.126:37775)
0811 11:45:24.812243 (+ 672us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:24.812266 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:24.812309 (+ 43us) server_negotiation.cc:407] Connection header received
0811 11:45:24.813224 (+ 915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:24.813248 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:24.813767 (+ 519us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:24.814095 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:24.814538 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:24.815988 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:24.816976 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:24.817700 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:24.818557 (+ 857us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:24.819121 (+ 564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:24.819130 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:24.819152 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:24.819702 (+ 550us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:24.819769 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:24.819796 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:24.819896 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:24.820064 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 11:45:24.820334 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":122,"threads_started":1}
I20260811 11:45:24.821480 27882 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:24.822474 27882 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e825c4476c64dbca903c17c7158b86c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37775 } }
I20260811 11:45:24.822849 27882 leader_election.cc:302] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9e825c4476c64dbca903c17c7158b86c; no voters:
I20260811 11:45:24.823237 27882 leader_election.cc:288] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:45:24.823417 27887 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:24.823742 27887 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c [term 1 LEADER]: Becoming Leader. State: Replica: 9e825c4476c64dbca903c17c7158b86c, State: Running, Role: LEADER
I20260811 11:45:24.824067 27887 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e825c4476c64dbca903c17c7158b86c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37775 } }
I20260811 11:45:24.824541 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:45:24.824566 27882 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:45:24.825316 27889 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e825c4476c64dbca903c17c7158b86c. Latest consensus state: current_term: 1 leader_uuid: "9e825c4476c64dbca903c17c7158b86c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e825c4476c64dbca903c17c7158b86c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37775 } } }
I20260811 11:45:24.825444 27889 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:24.826098 27888 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9e825c4476c64dbca903c17c7158b86c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e825c4476c64dbca903c17c7158b86c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37775 } } }
I20260811 11:45:24.826188 27888 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c [sys.catalog]: This master's current role is: LEADER
W20260811 11:45:24.829396 27906 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:45:24.829489 27906 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:45:24.829568 27896 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:45:24.830238 27896 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:45:24.836148 27896 catalog_manager.cc:1347] Generated new cluster ID: 3a40b9dffebd4f63a98903046b9453e3
I20260811 11:45:24.836227 27896 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:45:24.849629 27896 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:45:24.851045 27896 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:45:24.860472 27896 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9e825c4476c64dbca903c17c7158b86c: Generated new TSK 0
I20260811 11:45:24.861189 27896 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 11:45:24.892148 27917 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 11:45:24.892252 27917 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 11:45:24.892993 27885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:24.876970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45374 (local address 127.20.244.126:37775)
0811 11:45:24.877109 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:24.877114 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:24.877311 (+ 197us) server_negotiation.cc:407] Connection header received
0811 11:45:24.877455 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:24.877459 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:24.877517 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:24.877639 (+ 122us) server_negotiation.cc:226] Negotiated authn=JWT
0811 11:45:24.877867 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:24.878703 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:24.879624 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:24.879983 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:24.880082 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:24.880368 (+ 286us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 11:45:24.892551 (+ 12183us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36267/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 11:45:24.892823 (+ 272us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45374: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36267/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":55}
W20260811 11:45:24.893031 27916 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:24.876906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:37775 (local address 127.0.0.1:45374)
0811 11:45:24.877222 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:24.877235 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:24.877338 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:24.877650 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:24.877652 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:24.877659 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0811 11:45:24.877752 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:24.877757 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:24.878810 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:24.878813 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:24.879506 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:24.879515 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:24.880104 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:24.880107 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:24.880176 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:24.880197 (+ 21us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 11:45:24.892730 (+ 12533us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36267/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 11:45:24.892883 (+ 153us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.244.126:37775: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36267/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":129,"threads_started":1}
W20260811 11:45:24.893071 27885 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45374: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36267/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260811 11:45:24.894111 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 27802
2026-08-11T11:45:24Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (336 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 11:45:24.937969 21457 mini_oidc.cc:152] Starting JWKS server
I20260811 11:45:24.938881 21457 webserver.cc:460] Webserver started at https://127.0.0.1:34053/ using document root <none> and password file <none>
I20260811 11:45:24.939029 21457 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 11:45:24.939376 21457 webserver.cc:460] Webserver started at http://127.0.0.1:44419/ using document root <none> and password file <none>
2026-08-11T11:45:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:45:24Z Disabled control of system clock
I20260811 11:45:24.949481 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:39463
--webserver_interface=127.20.244.126
--webserver_port=0
--builtin_ntp_servers=127.20.244.84:43315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:39463
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34053/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 11:45:25.061573 27929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:25.061877 27929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:25.061949 27929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:25.066032 27929 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:25.066121 27929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:25.066154 27929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:25.066195 27929 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:25.066226 27929 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 11:45:25.066260 27929 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 11:45:25.066288 27929 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34053/jwks.json
I20260811 11:45:25.070988 27929 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:43315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:39463
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:39463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34053/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27929
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:25.072116 27929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:25.073539 27929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:25.082162 27936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:25.082150 27935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:25.082150 27938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:25.082406 27929 server_base.cc:1034] running on GCE node
I20260811 11:45:25.082948 27929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:25.084072 27929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:25.085232 27929 hybrid_clock.cc:648] HybridClock initialized: now 1786448725085204 us; error 41 us; skew 500 ppm
I20260811 11:45:25.086997 27929 webserver.cc:460] Webserver started at http://127.20.244.126:40569/ using document root <none> and password file <none>
I20260811 11:45:25.087590 27929 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:25.087680 27929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:25.087888 27929 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:25.089834 27929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "54782789040741e5a2cfc129568f6eef"
format_stamp: "Formatted at 2026-08-11 11:45:25 on dist-test-slave-vkjp"
server_key: "9b52cecf9d035e8e98937e582147a21d"
server_key_iv: "bcd0690083997ffcd7f9bc1c675eda92"
server_key_version: "encryptionkey@0"
I20260811 11:45:25.090359 27929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "54782789040741e5a2cfc129568f6eef"
format_stamp: "Formatted at 2026-08-11 11:45:25 on dist-test-slave-vkjp"
server_key: "9b52cecf9d035e8e98937e582147a21d"
server_key_iv: "bcd0690083997ffcd7f9bc1c675eda92"
server_key_version: "encryptionkey@0"
I20260811 11:45:25.093870 27929 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260811 11:45:25.096256 27944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:25.097426 27929 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 11:45:25.097553 27929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "54782789040741e5a2cfc129568f6eef"
format_stamp: "Formatted at 2026-08-11 11:45:25 on dist-test-slave-vkjp"
server_key: "9b52cecf9d035e8e98937e582147a21d"
server_key_iv: "bcd0690083997ffcd7f9bc1c675eda92"
server_key_version: "encryptionkey@0"
I20260811 11:45:25.097656 27929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:25.120533 27929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:25.121276 27929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:25.121500 27929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:25.129153 27929 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:39463
I20260811 11:45:25.129174 28008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:39463 every 8 connection(s)
I20260811 11:45:25.130153 27929 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:45:25.133442 28009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:25.135468 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 27929
I20260811 11:45:25.135602 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:45:25.135897 21457 external_mini_cluster.cc:1428] Setting key b178e4e5b72974a4b2b954720b6d8837
I20260811 11:45:25.139528 28009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef: Bootstrap starting.
I20260811 11:45:25.141819 28009 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:25.142596 28009 log.cc:824] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:25.145123 28009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef: No bootstrap required, opened a new log
I20260811 11:45:25.145677 28012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:25.137303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40426 (local address 127.20.244.126:39463)
0811 11:45:25.137944 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:25.137959 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:25.137994 (+ 35us) server_negotiation.cc:407] Connection header received
0811 11:45:25.138630 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:25.138646 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:25.139075 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:25.139469 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:25.139915 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:25.140935 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:25.141870 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:25.142404 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:25.142606 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:25.143586 (+ 980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:25.143593 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:25.143611 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:25.144130 (+ 519us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:25.144202 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:25.144232 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:25.144345 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:25.144463 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 11:45:25.144729 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":136,"threads_started":1}
I20260811 11:45:25.148613 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:45:25.149091 28009 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54782789040741e5a2cfc129568f6eef" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39463 } }
I20260811 11:45:25.149411 28009 raft_consensus.cc:374] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:25.149475 28009 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54782789040741e5a2cfc129568f6eef, State: Initialized, Role: FOLLOWER
I20260811 11:45:25.149945 28009 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54782789040741e5a2cfc129568f6eef" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39463 } }
I20260811 11:45:25.150074 28009 raft_consensus.cc:388] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:45:25.150161 28009 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:45:25.150283 28009 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:25.151316 28009 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54782789040741e5a2cfc129568f6eef" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39463 } }
I20260811 11:45:25.151681 28009 leader_election.cc:302] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54782789040741e5a2cfc129568f6eef; no voters:
I20260811 11:45:25.151984 28009 leader_election.cc:288] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:45:25.152140 28015 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:25.152375 28015 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef [term 1 LEADER]: Becoming Leader. State: Replica: 54782789040741e5a2cfc129568f6eef, State: Running, Role: LEADER
I20260811 11:45:25.152686 28015 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54782789040741e5a2cfc129568f6eef" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39463 } }
I20260811 11:45:25.153347 28009 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:45:25.154596 28018 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54782789040741e5a2cfc129568f6eef. Latest consensus state: current_term: 1 leader_uuid: "54782789040741e5a2cfc129568f6eef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54782789040741e5a2cfc129568f6eef" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39463 } } }
I20260811 11:45:25.154610 28016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "54782789040741e5a2cfc129568f6eef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54782789040741e5a2cfc129568f6eef" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39463 } } }
I20260811 11:45:25.154759 28016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:25.154758 28018 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:25.155243 28026 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:45:25.158479 28026 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:45:25.164249 28026 catalog_manager.cc:1347] Generated new cluster ID: 74053c1247a4448ba124428ba0b9bb4b
I20260811 11:45:25.164322 28026 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:45:25.174332 28026 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:45:25.175482 28026 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:45:25.183218 28026 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 54782789040741e5a2cfc129568f6eef: Generated new TSK 0
I20260811 11:45:25.183919 28026 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:45:25.205394 28012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:25.199943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40438 (local address 127.20.244.126:39463)
0811 11:45:25.200087 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:25.200092 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:25.200248 (+ 156us) server_negotiation.cc:407] Connection header received
0811 11:45:25.200391 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:25.200394 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:25.200459 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:25.200575 (+ 116us) server_negotiation.cc:226] Negotiated authn=JWT
0811 11:45:25.200951 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:25.201809 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:25.202714 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:25.203067 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:25.203191 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:25.203543 (+ 352us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 11:45:25.205016 (+ 1473us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34053/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 11:45:25.205260 (+ 244us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40438: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34053/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":56}
W20260811 11:45:25.205482 28012 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40438: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34053/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 11:45:25.207121 28046 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:25.199837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39463 (local address 127.0.0.1:40438)
0811 11:45:25.200160 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:25.200173 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:25.200272 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:25.200622 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:25.200625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:25.200633 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0811 11:45:25.200841 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:25.200848 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:25.201954 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:25.201957 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:25.202605 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:25.202613 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:25.203230 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:25.203233 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:25.203332 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:25.203356 (+ 24us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 11:45:25.205204 (+ 1848us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34053/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 11:45:25.206914 (+ 1710us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.244.126:39463: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34053/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":237,"mutex_wait_us":1508,"thread_start_us":117,"threads_started":1}
I20260811 11:45:25.208133 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 27929
E20260811 11:45:25.217126 28047 webserver.cc:533] Webserver: sslize failed:
E20260811 11:45:25.217214 28047 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T11:45:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (312 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T11:45:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:45:25Z Disabled control of system clock
I20260811 11:45:25.260845 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:37291
--webserver_interface=127.20.244.126
--webserver_port=0
--builtin_ntp_servers=127.20.244.84:40187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:37291
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786448696706302-21457-0/testchainca.cert with env {}
W20260811 11:45:25.377094 28052 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:25.377503 28052 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:25.377589 28052 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:25.381956 28052 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:25.382018 28052 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:25.382033 28052 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:25.382050 28052 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:25.382102 28052 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 11:45:25.382131 28052 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 11:45:25.382162 28052 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 11:45:25.387697 28052 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:40187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:37291
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:37291
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786448696706302-21457-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28052
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:25.388763 28052 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:25.389768 28052 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:25.398703 28060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:25.398792 28052 server_base.cc:1034] running on GCE node
W20260811 11:45:25.398718 28057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:25.398710 28058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:25.399509 28052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:25.400655 28052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:25.401855 28052 hybrid_clock.cc:648] HybridClock initialized: now 1786448725401846 us; error 29 us; skew 500 ppm
I20260811 11:45:25.403842 28052 webserver.cc:460] Webserver started at http://127.20.244.126:35187/ using document root <none> and password file <none>
I20260811 11:45:25.404457 28052 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:25.404557 28052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:25.404816 28052 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:25.406973 28052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "467c5f574f6e4ef8ba24f20c4785b6f4"
format_stamp: "Formatted at 2026-08-11 11:45:25 on dist-test-slave-vkjp"
server_key: "ab6ac3955d58ad63065f6c53bdb78d7c"
server_key_iv: "c2a9abf0639a1ab668b0b4de5fa63302"
server_key_version: "encryptionkey@0"
I20260811 11:45:25.407636 28052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "467c5f574f6e4ef8ba24f20c4785b6f4"
format_stamp: "Formatted at 2026-08-11 11:45:25 on dist-test-slave-vkjp"
server_key: "ab6ac3955d58ad63065f6c53bdb78d7c"
server_key_iv: "c2a9abf0639a1ab668b0b4de5fa63302"
server_key_version: "encryptionkey@0"
I20260811 11:45:25.411407 28052 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:45:25.414654 28068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:25.415977 28052 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:45:25.416128 28052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "467c5f574f6e4ef8ba24f20c4785b6f4"
format_stamp: "Formatted at 2026-08-11 11:45:25 on dist-test-slave-vkjp"
server_key: "ab6ac3955d58ad63065f6c53bdb78d7c"
server_key_iv: "c2a9abf0639a1ab668b0b4de5fa63302"
server_key_version: "encryptionkey@0"
I20260811 11:45:25.416250 28052 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:25.457897 28052 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:25.458673 28052 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:25.458889 28052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:25.466066 28052 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:37291
I20260811 11:45:25.466094 28137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:37291 every 8 connection(s)
I20260811 11:45:25.467039 28052 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:45:25.467373 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 28052
I20260811 11:45:25.467495 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:45:25.467857 21457 external_mini_cluster.cc:1428] Setting key 8140e9bf777287492c754679979da756
I20260811 11:45:25.470510 28138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:25.476001 28138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4: Bootstrap starting.
I20260811 11:45:25.477639 28142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:25.469277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36490 (local address 127.20.244.126:37291)
0811 11:45:25.470006 (+ 729us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:25.470024 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:25.470063 (+ 39us) server_negotiation.cc:407] Connection header received
0811 11:45:25.470847 (+ 784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:25.470867 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:25.471319 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:25.471665 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:25.472130 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:25.473192 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:25.474187 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:25.474692 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:25.474889 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:25.475863 (+ 974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:25.475868 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:25.475880 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:25.476327 (+ 447us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:25.476390 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:25.476411 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:25.476527 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:25.476653 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 11:45:25.476921 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":145,"threads_started":1}
I20260811 11:45:25.478327 28138 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:25.479220 28138 log.cc:824] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:25.480634 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:45:25.481446 28138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4: No bootstrap required, opened a new log
I20260811 11:45:25.485137 28138 raft_consensus.cc:348] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "467c5f574f6e4ef8ba24f20c4785b6f4" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37291 } }
I20260811 11:45:25.485354 28138 raft_consensus.cc:374] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:25.485416 28138 raft_consensus.cc:729] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 467c5f574f6e4ef8ba24f20c4785b6f4, State: Initialized, Role: FOLLOWER
I20260811 11:45:25.485847 28138 consensus_queue.cc:260] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "467c5f574f6e4ef8ba24f20c4785b6f4" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37291 } }
I20260811 11:45:25.485994 28138 raft_consensus.cc:388] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:45:25.486068 28138 raft_consensus.cc:482] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:45:25.486182 28138 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:25.487213 28138 raft_consensus.cc:504] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "467c5f574f6e4ef8ba24f20c4785b6f4" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37291 } }
I20260811 11:45:25.487557 28138 leader_election.cc:302] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 467c5f574f6e4ef8ba24f20c4785b6f4; no voters:
I20260811 11:45:25.487922 28138 leader_election.cc:288] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:45:25.488026 28144 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:25.488287 28144 raft_consensus.cc:686] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4 [term 1 LEADER]: Becoming Leader. State: Replica: 467c5f574f6e4ef8ba24f20c4785b6f4, State: Running, Role: LEADER
I20260811 11:45:25.488600 28144 consensus_queue.cc:237] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "467c5f574f6e4ef8ba24f20c4785b6f4" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37291 } }
I20260811 11:45:25.489158 28138 sys_catalog.cc:564] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:45:25.490343 28145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "467c5f574f6e4ef8ba24f20c4785b6f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "467c5f574f6e4ef8ba24f20c4785b6f4" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37291 } } }
I20260811 11:45:25.490483 28145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:25.490757 28146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 467c5f574f6e4ef8ba24f20c4785b6f4. Latest consensus state: current_term: 1 leader_uuid: "467c5f574f6e4ef8ba24f20c4785b6f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "467c5f574f6e4ef8ba24f20c4785b6f4" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37291 } } }
I20260811 11:45:25.490872 28146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:25.490972 28153 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:45:25.493768 28153 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:45:25.499822 28153 catalog_manager.cc:1347] Generated new cluster ID: e33b4c5fe65645b79b321702370942d5
I20260811 11:45:25.499905 28153 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:45:25.560669 28153 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:45:25.561734 28153 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:45:25.568610 28153 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 467c5f574f6e4ef8ba24f20c4785b6f4: Generated new TSK 0
I20260811 11:45:25.569339 28153 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:45:25.642198 28142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:25.576574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36498 (local address 127.20.244.126:37291)
0811 11:45:25.576718 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:25.576723 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:25.576911 (+ 188us) server_negotiation.cc:407] Connection header received
0811 11:45:25.577083 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:25.577086 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:25.577132 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:25.577222 (+ 90us) server_negotiation.cc:226] Negotiated authn=JWT
0811 11:45:25.577507 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:25.578020 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:25.579207 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:25.579417 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:25.579526 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:25.579853 (+ 327us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 11:45:25.641782 (+ 61929us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 11:45:25.642070 (+ 288us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36498: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":57}
W20260811 11:45:25.642289 28142 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36498: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 11:45:25.642470 28168 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:25.576489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:37291 (local address 127.0.0.1:36498)
0811 11:45:25.576814 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:25.576830 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:25.576951 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:25.577259 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:25.577263 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:25.577271 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0811 11:45:25.577385 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:25.577392 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:25.578145 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:25.578149 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:25.579072 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:25.579112 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:25.579563 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:25.579567 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:25.579656 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:25.579684 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 11:45:25.642051 (+ 62367us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 11:45:25.642243 (+ 192us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.244.126:37291: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":124,"threads_started":1}
I20260811 11:45:25.643235 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 28052
2026-08-11T11:45:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (418 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (132 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (131 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:45:25 dist-test-slave-vkjp krb5kdc[28180](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:45:25 dist-test-slave-vkjp krb5kdc[28180](info): set up 2 sockets
Aug 11 11:45:25 dist-test-slave-vkjp krb5kdc[28180](info): commencing operation
krb5kdc: starting...
W20260811 11:45:27.042153 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:45:27 dist-test-slave-vkjp krb5kdc[28180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:45:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:45:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:45:27.170809 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:34989
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:39551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:34989
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:27.284766 28200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:27.285055 28200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:27.285130 28200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:27.289098 28200 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:27.289184 28200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:27.289225 28200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:27.289283 28200 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:27.289322 28200 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:45:27.294480 28200 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:39551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:34989
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:34989
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:27.295508 28200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:27.296511 28200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:27.305066 28206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:27.305078 28208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:27.305145 28210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:27.305482 28200 server_base.cc:1034] running on GCE node
I20260811 11:45:27.305996 28200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:27.307123 28200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:27.308348 28200 hybrid_clock.cc:648] HybridClock initialized: now 1786448727308333 us; error 30 us; skew 500 ppm
Aug 11 11:45:27 dist-test-slave-vkjp krb5kdc[28180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448727, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:27.316220 28200 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:45:27.317137 28200 webserver.cc:460] Webserver started at http://127.20.244.126:33769/ using document root <none> and password file <none>
I20260811 11:45:27.317694 28200 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:27.317783 28200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:27.318017 28200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:27.320097 28200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "505f90d1aa534a3dbaeae6ceeaad3ab2"
format_stamp: "Formatted at 2026-08-11 11:45:27 on dist-test-slave-vkjp"
server_key: "20737af009ec6e8bf46f44721673a4e4"
server_key_iv: "b69e0455f888772ce641b0736d92ebe1"
server_key_version: "encryptionkey@0"
I20260811 11:45:27.320663 28200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "505f90d1aa534a3dbaeae6ceeaad3ab2"
format_stamp: "Formatted at 2026-08-11 11:45:27 on dist-test-slave-vkjp"
server_key: "20737af009ec6e8bf46f44721673a4e4"
server_key_iv: "b69e0455f888772ce641b0736d92ebe1"
server_key_version: "encryptionkey@0"
I20260811 11:45:27.324476 28200 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 11:45:27.326848 28220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:27.328169 28200 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 11:45:27.328387 28200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "505f90d1aa534a3dbaeae6ceeaad3ab2"
format_stamp: "Formatted at 2026-08-11 11:45:27 on dist-test-slave-vkjp"
server_key: "20737af009ec6e8bf46f44721673a4e4"
server_key_iv: "b69e0455f888772ce641b0736d92ebe1"
server_key_version: "encryptionkey@0"
I20260811 11:45:27.328496 28200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:27.353538 28200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:27.356887 28200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:27.357105 28200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:27.364235 28200 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:34989
I20260811 11:45:27.364323 28278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:34989 every 8 connection(s)
I20260811 11:45:27.365201 28200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:45:27.367383 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 28200
I20260811 11:45:27.367519 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:45:27.367820 21457 external_mini_cluster.cc:1428] Setting key 0a5950da23c644a1de456e583c598ece
I20260811 11:45:27.368237 28280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:27.375010 28280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2: Bootstrap starting.
Aug 11 11:45:27 dist-test-slave-vkjp krb5kdc[28180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:27.377931 28280 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:27.378655 28280 log.cc:824] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:27.381054 28280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2: No bootstrap required, opened a new log
I20260811 11:45:27.383589 28284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:27.369218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34370 (local address 127.20.244.126:34989)
0811 11:45:27.369617 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:27.369633 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:27.369667 (+ 34us) server_negotiation.cc:407] Connection header received
0811 11:45:27.370307 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:27.370323 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:27.370625 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:27.370896 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:27.372030 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:27.373227 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:27.374458 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:27.374999 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:27.375278 (+ 279us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:27.378564 (+ 3286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:27.378573 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:27.378598 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:27.378631 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:27.380749 (+ 2118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:27.381227 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:27.381234 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:27.381239 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:27.381369 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:27.381668 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:27.381672 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:27.381673 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:27.382055 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:27.382252 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:27.382530 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 11:45:27.382816 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":135,"threads_started":1}
I20260811 11:45:27.384678 28280 raft_consensus.cc:348] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505f90d1aa534a3dbaeae6ceeaad3ab2" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34989 } }
I20260811 11:45:27.384915 28280 raft_consensus.cc:374] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:27.385002 28280 raft_consensus.cc:729] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505f90d1aa534a3dbaeae6ceeaad3ab2, State: Initialized, Role: FOLLOWER
I20260811 11:45:27.385455 28280 consensus_queue.cc:260] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505f90d1aa534a3dbaeae6ceeaad3ab2" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34989 } }
I20260811 11:45:27.385604 28280 raft_consensus.cc:388] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:45:27.385689 28280 raft_consensus.cc:482] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:45:27.385787 28280 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:27.386651 28280 raft_consensus.cc:504] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505f90d1aa534a3dbaeae6ceeaad3ab2" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34989 } }
I20260811 11:45:27.386981 28280 leader_election.cc:302] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 505f90d1aa534a3dbaeae6ceeaad3ab2; no voters:
I20260811 11:45:27.387315 28280 leader_election.cc:288] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:45:27.387434 28286 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:27.387679 28286 raft_consensus.cc:686] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2 [term 1 LEADER]: Becoming Leader. State: Replica: 505f90d1aa534a3dbaeae6ceeaad3ab2, State: Running, Role: LEADER
I20260811 11:45:27.387980 28286 consensus_queue.cc:237] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505f90d1aa534a3dbaeae6ceeaad3ab2" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34989 } }
I20260811 11:45:27.388582 28280 sys_catalog.cc:564] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:45:27.389760 28289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 505f90d1aa534a3dbaeae6ceeaad3ab2. Latest consensus state: current_term: 1 leader_uuid: "505f90d1aa534a3dbaeae6ceeaad3ab2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505f90d1aa534a3dbaeae6ceeaad3ab2" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34989 } } }
I20260811 11:45:27.389765 28288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "505f90d1aa534a3dbaeae6ceeaad3ab2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505f90d1aa534a3dbaeae6ceeaad3ab2" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34989 } } }
I20260811 11:45:27.389925 28289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:27.389981 28288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:27.390828 28299 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:45:27.393584 28299 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:45:27.399603 28299 catalog_manager.cc:1347] Generated new cluster ID: fe50ae07097643f0acf950a408151ab3
I20260811 11:45:27.399677 28299 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:45:27.414356 28299 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:45:27.416236 28299 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:45:27.422812 28299 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 505f90d1aa534a3dbaeae6ceeaad3ab2: Generated new TSK 0
I20260811 11:45:27.423631 28299 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.244.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
I20260811 11:45:27.458410 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:34989
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:39551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:27.575352 28315 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:27.575640 28315 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:27.575716 28315 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:27.579762 28315 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:27.579839 28315 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:27.579927 28315 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:45:27.585127 28315 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:39551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:34989
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28315
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:27.586154 28315 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:27.587636 28315 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:27.600553 28322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:27.600674 28315 server_base.cc:1034] running on GCE node
W20260811 11:45:27.600600 28325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:27.601011 28323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:27.601433 28315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:27.602103 28315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:27.603413 28315 hybrid_clock.cc:648] HybridClock initialized: now 1786448727603360 us; error 51 us; skew 500 ppm
Aug 11 11:45:27 dist-test-slave-vkjp krb5kdc[28180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448727, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:27.606717 28315 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:45:27.607919 28315 webserver.cc:460] Webserver started at http://127.20.244.65:41333/ using document root <none> and password file <none>
I20260811 11:45:27.608582 28315 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:27.608677 28315 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:27.608943 28315 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:27.612277 28315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "6409c8cd75ca40479717629d3acc9083"
format_stamp: "Formatted at 2026-08-11 11:45:27 on dist-test-slave-vkjp"
server_key: "2f18e864ec539b6271631a5d37e13fb7"
server_key_iv: "8864904d34a3c68ede0c34fb6db6642a"
server_key_version: "encryptionkey@0"
I20260811 11:45:27.613040 28315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "6409c8cd75ca40479717629d3acc9083"
format_stamp: "Formatted at 2026-08-11 11:45:27 on dist-test-slave-vkjp"
server_key: "2f18e864ec539b6271631a5d37e13fb7"
server_key_iv: "8864904d34a3c68ede0c34fb6db6642a"
server_key_version: "encryptionkey@0"
I20260811 11:45:27.618551 28315 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 11:45:27.621245 28333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:27.622483 28315 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260811 11:45:27.622625 28315 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "6409c8cd75ca40479717629d3acc9083"
format_stamp: "Formatted at 2026-08-11 11:45:27 on dist-test-slave-vkjp"
server_key: "2f18e864ec539b6271631a5d37e13fb7"
server_key_iv: "8864904d34a3c68ede0c34fb6db6642a"
server_key_version: "encryptionkey@0"
I20260811 11:45:27.622748 28315 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:27.644855 28315 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:27.648227 28315 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:27.648474 28315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:27.649114 28315 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:27.650002 28315 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:27.650086 28315 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:27.650161 28315 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:27.650213 28315 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:27.660028 28315 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:40013
I20260811 11:45:27.660049 28468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:40013 every 8 connection(s)
I20260811 11:45:27.661057 28315 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:45:27.666393 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 28315
I20260811 11:45:27.666533 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:45:27.666801 21457 external_mini_cluster.cc:1428] Setting key 0532c24ec679b1485b4930771dcb159d
Aug 11 11:45:27 dist-test-slave-vkjp krb5kdc[28180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448727, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:27.677389 28284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:27.663065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:52951 (local address 127.20.244.126:34989)
0811 11:45:27.663241 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:27.663245 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:27.664121 (+ 876us) server_negotiation.cc:407] Connection header received
0811 11:45:27.665561 (+ 1440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:27.665565 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:27.665627 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:27.665731 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:27.667033 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:27.667799 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:27.669575 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:27.669813 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:27.669925 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:27.673078 (+ 3153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:27.673086 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:27.673092 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:27.673128 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:27.674962 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:27.675583 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:27.675589 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:27.675592 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:27.675699 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:27.676079 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:27.676083 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:27.676084 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:27.676357 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:27.676475 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:27.677021 (+ 546us) server_negotiation.cc:299] Negotiation successful
0811 11:45:27.677173 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 11:45:27.678140 28471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:27.663489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:34989 (local address 127.20.244.65:52951)
0811 11:45:27.663961 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:27.664005 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:27.665329 (+ 1324us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:27.665922 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:27.665929 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:27.666283 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:27.666844 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:27.666859 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:27.667937 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:27.667940 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:27.669402 (+ 1462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:27.669418 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:27.670001 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:27.670007 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:27.670255 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:27.671021 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:27.671038 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:27.672880 (+ 1842us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:27.675158 (+ 2278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:27.675164 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:27.675179 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:27.675470 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:27.675809 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:27.675811 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:27.675813 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:27.675965 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:27.676473 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:27.676478 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:27.676730 (+ 252us) client_negotiation.cc:769] Sending connection context
0811 11:45:27.676899 (+ 169us) client_negotiation.cc:240] Negotiation successful
0811 11:45:27.677176 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":122,"threads_started":1}
WARNING: no policy specified for kudu/127.20.244.66@KRBTEST.COM; defaulting to no policy
I20260811 11:45:27.679565 28469 heartbeater.cc:347] Connected to a master server at 127.20.244.126:34989
I20260811 11:45:27.679839 28469 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:27.680327 28469 heartbeater.cc:511] Master 127.20.244.126:34989 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.66@KRBTEST.COM" created.
I20260811 11:45:27.681972 28240 ts_manager.cc:194] Registered new tserver with Master: 6409c8cd75ca40479717629d3acc9083 (127.20.244.65:40013)
I20260811 11:45:27.683180 28240 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:52951
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
I20260811 11:45:27.702306 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:34989
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:39551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:27.815816 28475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:27.816087 28475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:27.816161 28475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:27.820156 28475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:27.820240 28475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:27.820328 28475 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:45:27.825399 28475 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:39551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:34989
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28475
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:27.826459 28475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:27.827539 28475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:27.837757 28483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:27.837728 28486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:27.837749 28482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:27.837939 28475 server_base.cc:1034] running on GCE node
I20260811 11:45:27.838366 28475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:27.838971 28475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:27.840129 28475 hybrid_clock.cc:648] HybridClock initialized: now 1786448727840110 us; error 30 us; skew 500 ppm
Aug 11 11:45:27 dist-test-slave-vkjp krb5kdc[28180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448727, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:27.842814 28475 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:45:27.843727 28475 webserver.cc:460] Webserver started at http://127.20.244.66:38965/ using document root <none> and password file <none>
I20260811 11:45:27.844278 28475 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:27.844369 28475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:27.844624 28475 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:27.846633 28475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "fa08ed7d794041be8a7f396c7f9dd7bb"
format_stamp: "Formatted at 2026-08-11 11:45:27 on dist-test-slave-vkjp"
server_key: "effbbee4e52cd32b1477d39effc74bb3"
server_key_iv: "64551dbaf51e0dfd966608c033d27d54"
server_key_version: "encryptionkey@0"
I20260811 11:45:27.847236 28475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "fa08ed7d794041be8a7f396c7f9dd7bb"
format_stamp: "Formatted at 2026-08-11 11:45:27 on dist-test-slave-vkjp"
server_key: "effbbee4e52cd32b1477d39effc74bb3"
server_key_iv: "64551dbaf51e0dfd966608c033d27d54"
server_key_version: "encryptionkey@0"
I20260811 11:45:27.850876 28475 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:45:27.853230 28494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:27.854378 28475 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:27.854525 28475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "fa08ed7d794041be8a7f396c7f9dd7bb"
format_stamp: "Formatted at 2026-08-11 11:45:27 on dist-test-slave-vkjp"
server_key: "effbbee4e52cd32b1477d39effc74bb3"
server_key_iv: "64551dbaf51e0dfd966608c033d27d54"
server_key_version: "encryptionkey@0"
I20260811 11:45:27.854631 28475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:27.874837 28475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:27.878103 28475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:27.878334 28475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:27.878985 28475 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:27.879957 28475 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:27.880028 28475 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:27.880105 28475 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:27.880158 28475 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:27.889441 28475 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:40985
I20260811 11:45:27.889531 28630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:40985 every 8 connection(s)
I20260811 11:45:27.890429 28475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:45:27.899715 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 28475
I20260811 11:45:27.899852 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
Aug 11 11:45:27 dist-test-slave-vkjp krb5kdc[28180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448727, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:27.900171 21457 external_mini_cluster.cc:1428] Setting key c5d194cecf06f9013e5df9b4d5ed6199
I20260811 11:45:27.904300 28284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:27.892267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:42961 (local address 127.20.244.126:34989)
0811 11:45:27.892416 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:27.892420 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:27.893197 (+ 777us) server_negotiation.cc:407] Connection header received
0811 11:45:27.894641 (+ 1444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:27.894645 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:27.894694 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:27.894773 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:27.895982 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:27.896529 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:27.897636 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:27.897875 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:27.897960 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:27.900728 (+ 2768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:27.900731 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:27.900733 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:27.900758 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:27.902231 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:27.902746 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:27.902755 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:27.902757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:27.902833 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:27.903203 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:27.903207 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:27.903209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:27.903400 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:27.903512 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:27.904005 (+ 493us) server_negotiation.cc:299] Negotiation successful
0811 11:45:27.904123 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 11:45:27.905045 28633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:27.892610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:34989 (local address 127.20.244.66:42961)
0811 11:45:27.893041 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:27.893082 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:27.894432 (+ 1350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:27.894935 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:27.894942 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:27.895352 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:27.895830 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:27.895843 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:27.896642 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:27.896645 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:27.897516 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:27.897525 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:27.898011 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:27.898014 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:27.898151 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:27.898779 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:27.898796 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:27.900555 (+ 1759us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:27.902363 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:27.902369 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:27.902383 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:27.902634 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:27.902929 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:27.902932 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:27.902934 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:27.903072 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:27.903511 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:27.903519 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:27.903756 (+ 237us) client_negotiation.cc:769] Sending connection context
0811 11:45:27.903941 (+ 185us) client_negotiation.cc:240] Negotiation successful
0811 11:45:27.904248 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":117,"threads_started":1}
I20260811 11:45:27.906208 28631 heartbeater.cc:347] Connected to a master server at 127.20.244.126:34989
I20260811 11:45:27.906451 28631 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:27.906926 28631 heartbeater.cc:511] Master 127.20.244.126:34989 requested a full tablet report, sending...
I20260811 11:45:27.908042 28240 ts_manager.cc:194] Registered new tserver with Master: fa08ed7d794041be8a7f396c7f9dd7bb (127.20.244.66:40985)
I20260811 11:45:27.908941 28240 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:42961
WARNING: no policy specified for kudu/127.20.244.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
I20260811 11:45:27.931147 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:34989
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:39551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:28.047906 28637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:28.048153 28637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:28.048203 28637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:28.052204 28637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:28.052260 28637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:28.052321 28637 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:45:28.057498 28637 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:39551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:34989
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:28.058701 28637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:28.059752 28637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:28.069546 28644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:28.069532 28643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:28.069535 28648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:28.069777 28637 server_base.cc:1034] running on GCE node
I20260811 11:45:28.070344 28637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:28.070969 28637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:28.072129 28637 hybrid_clock.cc:648] HybridClock initialized: now 1786448728072101 us; error 40 us; skew 500 ppm
Aug 11 11:45:28 dist-test-slave-vkjp krb5kdc[28180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448728, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:28.074957 28637 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:45:28.075863 28637 webserver.cc:460] Webserver started at http://127.20.244.67:43645/ using document root <none> and password file <none>
I20260811 11:45:28.076437 28637 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:28.076531 28637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:28.076769 28637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:28.078861 28637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "c38c0a503d0a48dd97bb903dfa2049c9"
format_stamp: "Formatted at 2026-08-11 11:45:28 on dist-test-slave-vkjp"
server_key: "5d01132beb05318e4ad6b3efbf70bd86"
server_key_iv: "3685bfd8f8aebb33149dd8f475474e26"
server_key_version: "encryptionkey@0"
I20260811 11:45:28.079478 28637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "c38c0a503d0a48dd97bb903dfa2049c9"
format_stamp: "Formatted at 2026-08-11 11:45:28 on dist-test-slave-vkjp"
server_key: "5d01132beb05318e4ad6b3efbf70bd86"
server_key_iv: "3685bfd8f8aebb33149dd8f475474e26"
server_key_version: "encryptionkey@0"
I20260811 11:45:28.083245 28637 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 11:45:28.085669 28655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:28.086890 28637 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:28.087038 28637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "c38c0a503d0a48dd97bb903dfa2049c9"
format_stamp: "Formatted at 2026-08-11 11:45:28 on dist-test-slave-vkjp"
server_key: "5d01132beb05318e4ad6b3efbf70bd86"
server_key_iv: "3685bfd8f8aebb33149dd8f475474e26"
server_key_version: "encryptionkey@0"
I20260811 11:45:28.087208 28637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:28.108919 28637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:28.112228 28637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:28.112480 28637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:28.113070 28637 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:28.113900 28637 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:28.113969 28637 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:28.114040 28637 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:28.114195 28637 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:28.123458 28637 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:35743
I20260811 11:45:28.123487 28790 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:35743 every 8 connection(s)
I20260811 11:45:28.124347 28637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:45:28.128902 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 28637
I20260811 11:45:28.129032 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:45:28.129377 21457 external_mini_cluster.cc:1428] Setting key 772b3901c12f1ba460fc99c5955a97ac
Aug 11 11:45:28 dist-test-slave-vkjp krb5kdc[28180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448728, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:28.139277 28284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:28.126206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:33033 (local address 127.20.244.126:34989)
0811 11:45:28.126339 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:28.126342 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:28.127156 (+ 814us) server_negotiation.cc:407] Connection header received
0811 11:45:28.128751 (+ 1595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:28.128754 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:28.128804 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:28.128881 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:28.130400 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:28.131027 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:28.132381 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:28.132634 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:28.132745 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:28.135615 (+ 2870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:28.135618 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:28.135621 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:28.135649 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:28.137371 (+ 1722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:28.137835 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:28.137838 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:28.137839 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:28.137924 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:28.138254 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:28.138257 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:28.138258 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:28.138455 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:28.138539 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:28.138986 (+ 447us) server_negotiation.cc:299] Negotiation successful
0811 11:45:28.139147 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 11:45:28.140070 28795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:28.126538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:34989 (local address 127.20.244.67:33033)
0811 11:45:28.126988 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:28.127029 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:28.128506 (+ 1477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:28.129087 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:28.129096 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:28.129584 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:28.130231 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:28.130252 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:28.131188 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:28.131192 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:28.132237 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:28.132247 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:28.132787 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:28.132791 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:28.132974 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:28.133523 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:28.133539 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:28.135443 (+ 1904us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:28.137482 (+ 2039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:28.137487 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:28.137499 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:28.137744 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:28.138011 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:28.138014 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:28.138015 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:28.138144 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:28.138550 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:28.138555 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:28.138777 (+ 222us) client_negotiation.cc:769] Sending connection context
0811 11:45:28.138933 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 11:45:28.139240 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":106,"threads_started":1}
I20260811 11:45:28.141242 28791 heartbeater.cc:347] Connected to a master server at 127.20.244.126:34989
I20260811 11:45:28.141484 28791 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:28.142020 28791 heartbeater.cc:511] Master 127.20.244.126:34989 requested a full tablet report, sending...
I20260811 11:45:28.143069 28240 ts_manager.cc:194] Registered new tserver with Master: c38c0a503d0a48dd97bb903dfa2049c9 (127.20.244.67:35743)
I20260811 11:45:28.143512 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:45:28.143766 28240 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:33033
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/test-admin.keytab.
Aug 11 11:45:28 dist-test-slave-vkjp krb5kdc[28180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:28.160276 21457 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 11:45:28.163479 28800 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:28.161829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55086 (local address 127.20.244.65:40013)
0811 11:45:28.162152 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:28.162172 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:28.162200 (+ 28us) server_negotiation.cc:407] Connection header received
0811 11:45:28.162263 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:28.162275 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:28.162481 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:28.162606 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:28.163283 (+ 677us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55086: BlockingRecv error: recv got EOF from 127.0.0.1:55086 (error 108)
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":105,"threads_started":1}
W20260811 11:45:28.163586 21457 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/krb5cc' of type FILE
Aug 11 11:45:28 dist-test-slave-vkjp krb5kdc[28180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:28.164642 21457 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 11:45:28 dist-test-slave-vkjp krb5kdc[28180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:28.165582 21457 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 11:45:28 dist-test-slave-vkjp krb5kdc[28180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.65@KRBTEST.COM
I20260811 11:45:28.175377 28800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:28.166452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55096 (local address 127.20.244.65:40013)
0811 11:45:28.166578 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:28.166581 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:28.166702 (+ 121us) server_negotiation.cc:407] Connection header received
0811 11:45:28.166802 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:28.166804 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:28.166842 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:28.166913 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:28.167485 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:28.168276 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:28.169103 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:28.169489 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:28.169585 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:28.171848 (+ 2263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:28.171858 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:28.171870 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:28.171892 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:28.173600 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:28.174031 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:28.174037 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:28.174039 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:28.174137 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:28.174433 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:28.174436 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:28.174438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:28.174703 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:28.174888 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:28.175045 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 11:45:28.175236 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260811 11:45:28.179205 28800 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:28.178199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55106 (local address 127.20.244.65:40013)
0811 11:45:28.178319 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:28.178323 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:28.178459 (+ 136us) server_negotiation.cc:407] Connection header received
0811 11:45:28.178546 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:28.178548 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:28.178600 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:28.178694 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:28.179115 (+ 421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55106: BlockingRecv error: recv got EOF from 127.0.0.1:55106 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 11:45:28.179415 21457 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/krb5cc' of type FILE
Aug 11 11:45:28 dist-test-slave-vkjp krb5kdc[28180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:28.180473 21457 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 11:45:28 dist-test-slave-vkjp krb5kdc[28180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:28.181454 21457 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 11:45:28 dist-test-slave-vkjp krb5kdc[28180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.65@KRBTEST.COM
I20260811 11:45:28.190199 28800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:28.182288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55108 (local address 127.20.244.65:40013)
0811 11:45:28.182425 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:28.182431 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:28.182636 (+ 205us) server_negotiation.cc:407] Connection header received
0811 11:45:28.182697 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:28.182699 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:28.182734 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:28.182814 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:28.183490 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:28.184015 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:28.184780 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:28.185012 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:28.185089 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:28.187337 (+ 2248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:28.187340 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:28.187342 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:28.187365 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:28.188658 (+ 1293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:28.189046 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:28.189049 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:28.189050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:28.189121 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:28.189345 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:28.189347 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:28.189348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:28.189566 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:28.189667 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:28.189867 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 11:45:28.190014 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260811 11:45:28.193048 28800 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:28.192195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55110 (local address 127.20.244.65:40013)
0811 11:45:28.192353 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:28.192357 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:28.192432 (+ 75us) server_negotiation.cc:407] Connection header received
0811 11:45:28.192498 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:28.192499 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:28.192531 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:28.192592 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:28.192933 (+ 341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55110: BlockingRecv error: recv got EOF from 127.0.0.1:55110 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
W20260811 11:45:28.193109 21457 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786448696706302-21457-0/krb5kdc/krb5cc' of type FILE
Aug 11 11:45:28 dist-test-slave-vkjp krb5kdc[28180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:28.194070 21457 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 11:45:28 dist-test-slave-vkjp krb5kdc[28180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:28.194917 21457 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 11:45:28 dist-test-slave-vkjp krb5kdc[28180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.65@KRBTEST.COM
I20260811 11:45:28.203451 28800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:28.195712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55114 (local address 127.20.244.65:40013)
0811 11:45:28.195830 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:28.195834 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:28.195934 (+ 100us) server_negotiation.cc:407] Connection header received
0811 11:45:28.196040 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:28.196044 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:28.196085 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:28.196164 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:28.196644 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:28.197164 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:28.197949 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:28.198164 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:28.198266 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:28.200497 (+ 2231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:28.200500 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:28.200502 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:28.200523 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:28.201810 (+ 1287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:28.202241 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:28.202245 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:28.202247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:28.202326 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:28.202616 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:28.202620 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:28.202621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:28.202784 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:28.202926 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:28.203189 (+ 263us) server_negotiation.cc:299] Negotiation successful
0811 11:45:28.203294 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 11:45:28.204531 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 28315
I20260811 11:45:28.214023 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 28475
I20260811 11:45:28.223212 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 28637
I20260811 11:45:28.230876 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 28200
2026-08-11T11:45:28Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2319 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:45:28 dist-test-slave-vkjp krb5kdc[28819](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:45:28 dist-test-slave-vkjp krb5kdc[28819](info): set up 2 sockets
Aug 11 11:45:28 dist-test-slave-vkjp krb5kdc[28819](info): commencing operation
krb5kdc: starting...
W20260811 11:45:29.429536 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:45:29 dist-test-slave-vkjp krb5kdc[28819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448729, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:45:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:45:29Z Disabled control of system clock
WARNING: no policy specified for oryx/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.126.keytab.
Entry for principal oryx/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.126.keytab.
I20260811 11:45:29.557842 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:33249
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.126.keytab
--principal=oryx/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:38121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:33249
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:29.674341 28834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:29.674605 28834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:29.674647 28834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:29.678721 28834 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:29.678782 28834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:29.678804 28834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:29.678821 28834 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:29.678838 28834 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:45:29.684108 28834 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:38121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:33249
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.126.keytab
--principal=oryx/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:33249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28834
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:29.685163 28834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:29.686192 28834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:29.694811 28840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:29.694862 28843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:29.694802 28841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:29.695158 28834 server_base.cc:1034] running on GCE node
I20260811 11:45:29.695888 28834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:29.697018 28834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:29.698238 28834 hybrid_clock.cc:648] HybridClock initialized: now 1786448729698200 us; error 49 us; skew 500 ppm
Aug 11 11:45:29 dist-test-slave-vkjp krb5kdc[28819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448729, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:29.701195 28834 init.cc:377] Logged in from keytab as oryx/127.20.244.126@KRBTEST.COM (short username oryx)
I20260811 11:45:29.702065 28834 webserver.cc:460] Webserver started at http://127.20.244.126:40531/ using document root <none> and password file <none>
I20260811 11:45:29.702621 28834 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:29.702716 28834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:29.702976 28834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:29.705080 28834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "dc3a5b075c0b4be29c9047591ab3d38c"
format_stamp: "Formatted at 2026-08-11 11:45:29 on dist-test-slave-vkjp"
server_key: "c7c6dec0a778275e31c3374673394010"
server_key_iv: "2579965c67766fec0af44887a45a1c3c"
server_key_version: "encryptionkey@0"
I20260811 11:45:29.705647 28834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "dc3a5b075c0b4be29c9047591ab3d38c"
format_stamp: "Formatted at 2026-08-11 11:45:29 on dist-test-slave-vkjp"
server_key: "c7c6dec0a778275e31c3374673394010"
server_key_iv: "2579965c67766fec0af44887a45a1c3c"
server_key_version: "encryptionkey@0"
I20260811 11:45:29.709342 28834 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 11:45:29.711719 28851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:29.712908 28834 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:45:29.713052 28834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "dc3a5b075c0b4be29c9047591ab3d38c"
format_stamp: "Formatted at 2026-08-11 11:45:29 on dist-test-slave-vkjp"
server_key: "c7c6dec0a778275e31c3374673394010"
server_key_iv: "2579965c67766fec0af44887a45a1c3c"
server_key_version: "encryptionkey@0"
I20260811 11:45:29.713163 28834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:29.741571 28834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:29.745015 28834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:29.745231 28834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:29.752439 28834 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:33249
I20260811 11:45:29.752774 28916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:33249 every 8 connection(s)
I20260811 11:45:29.753494 28834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:45:29.754451 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 28834
I20260811 11:45:29.754591 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:45:29.754905 21457 external_mini_cluster.cc:1428] Setting key edecf4ea8d520d741be91d6c59136a3a
I20260811 11:45:29.756870 28917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:29.763468 28917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c: Bootstrap starting.
Aug 11 11:45:29 dist-test-slave-vkjp krb5kdc[28819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448729, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM
I20260811 11:45:29.765697 28917 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:29.766403 28917 log.cc:824] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:29.768266 28917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c: No bootstrap required, opened a new log
I20260811 11:45:29.769963 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:29.756270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44878 (local address 127.20.244.126:33249)
0811 11:45:29.756708 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:29.756724 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:29.756760 (+ 36us) server_negotiation.cc:407] Connection header received
0811 11:45:29.757455 (+ 695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:29.757485 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:29.757802 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:29.758068 (+ 266us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:29.758972 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:29.760057 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:29.761226 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:29.761692 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:29.761836 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:29.764887 (+ 3051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:29.764892 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:29.764904 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:29.764931 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:29.766925 (+ 1994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:29.767471 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:29.767482 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:29.767486 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:29.767607 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:29.767956 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:29.767961 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:29.767963 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:29.768429 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:29.768644 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:29.768990 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 11:45:29.769307 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":151,"threads_started":1}
I20260811 11:45:29.772168 28917 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } }
I20260811 11:45:29.772415 28917 raft_consensus.cc:374] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:29.772492 28917 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc3a5b075c0b4be29c9047591ab3d38c, State: Initialized, Role: FOLLOWER
I20260811 11:45:29.772876 28917 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } }
I20260811 11:45:29.773013 28917 raft_consensus.cc:388] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:45:29.773077 28917 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:45:29.773186 28917 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:29.774019 28917 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } }
I20260811 11:45:29.774375 28917 leader_election.cc:302] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc3a5b075c0b4be29c9047591ab3d38c; no voters:
I20260811 11:45:29.774694 28917 leader_election.cc:288] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:45:29.774907 28923 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:29.775305 28923 raft_consensus.cc:686] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [term 1 LEADER]: Becoming Leader. State: Replica: dc3a5b075c0b4be29c9047591ab3d38c, State: Running, Role: LEADER
I20260811 11:45:29.775589 28923 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } }
I20260811 11:45:29.776057 28917 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:45:29.777421 28924 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } }
I20260811 11:45:29.777467 28925 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc3a5b075c0b4be29c9047591ab3d38c. Latest consensus state: current_term: 1 leader_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } }
I20260811 11:45:29.777561 28924 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:29.777568 28925 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [sys.catalog]: This master's current role is: LEADER
W20260811 11:45:29.780881 28940 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:45:29.780949 28940 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:45:29.781032 28936 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:45:29.781745 28936 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:45:29.787189 28936 catalog_manager.cc:1347] Generated new cluster ID: 099b90cae7d948e6920e7219d648152b
I20260811 11:45:29.787253 28936 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:45:29.794781 28936 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:45:29.795712 28936 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:45:29.803745 28936 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c: Generated new TSK 0
I20260811 11:45:29.804409 28936 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.20.244.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.244.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.244.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.65.keytab.
Entry for principal oryx/127.20.244.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.65.keytab.
I20260811 11:45:29.843022 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:33249
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.65.keytab
--principal=oryx/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:38121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:29.956581 28949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:29.956835 28949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:29.956913 28949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:29.960978 28949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:29.961051 28949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:29.961143 28949 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:45:29.966358 28949 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:38121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.65.keytab
--principal=oryx/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:33249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:29.967561 28949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:29.968611 28949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:29.979005 28958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:29.979055 28962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:29.979020 28960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:29.979215 28949 server_base.cc:1034] running on GCE node
I20260811 11:45:29.979823 28949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:29.980504 28949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:29.981678 28949 hybrid_clock.cc:648] HybridClock initialized: now 1786448729981652 us; error 46 us; skew 500 ppm
Aug 11 11:45:29 dist-test-slave-vkjp krb5kdc[28819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448729, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:29.984645 28949 init.cc:377] Logged in from keytab as oryx/127.20.244.65@KRBTEST.COM (short username oryx)
I20260811 11:45:29.985575 28949 webserver.cc:460] Webserver started at http://127.20.244.65:41347/ using document root <none> and password file <none>
I20260811 11:45:29.986135 28949 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:29.986197 28949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:29.986414 28949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:29.988488 28949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "09025679fb854a8dadd0ff0e1952e5f9"
format_stamp: "Formatted at 2026-08-11 11:45:29 on dist-test-slave-vkjp"
server_key: "d61a65670126aff7fab27caf9e422aa6"
server_key_iv: "366dc0619780c2ba7a2bdb8652065d2b"
server_key_version: "encryptionkey@0"
I20260811 11:45:29.989048 28949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "09025679fb854a8dadd0ff0e1952e5f9"
format_stamp: "Formatted at 2026-08-11 11:45:29 on dist-test-slave-vkjp"
server_key: "d61a65670126aff7fab27caf9e422aa6"
server_key_iv: "366dc0619780c2ba7a2bdb8652065d2b"
server_key_version: "encryptionkey@0"
I20260811 11:45:29.992858 28949 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 11:45:29.995245 28971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:29.996524 28949 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:29.996688 28949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "09025679fb854a8dadd0ff0e1952e5f9"
format_stamp: "Formatted at 2026-08-11 11:45:29 on dist-test-slave-vkjp"
server_key: "d61a65670126aff7fab27caf9e422aa6"
server_key_iv: "366dc0619780c2ba7a2bdb8652065d2b"
server_key_version: "encryptionkey@0"
I20260811 11:45:29.996801 28949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:30.009684 28949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:30.012773 28949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:30.012985 28949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:30.013592 28949 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:30.014436 28949 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:30.014509 28949 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:30.014583 28949 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:30.014626 28949 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:30.023811 28949 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:45231
I20260811 11:45:30.023851 29109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:45231 every 8 connection(s)
I20260811 11:45:30.024689 28949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:45:30.030608 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 28949
I20260811 11:45:30.030745 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:45:30.031044 21457 external_mini_cluster.cc:1428] Setting key fc304f4d2b0c85ddd0985685b468008c
Aug 11 11:45:30 dist-test-slave-vkjp krb5kdc[28819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448729, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM
I20260811 11:45:30.040393 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:30.026601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:41091 (local address 127.20.244.126:33249)
0811 11:45:30.026761 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:30.026766 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:30.027756 (+ 990us) server_negotiation.cc:407] Connection header received
0811 11:45:30.029139 (+ 1383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:30.029142 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:30.029187 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:30.029269 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:30.030496 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.031330 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.032930 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.033318 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.033451 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:30.036275 (+ 2824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:30.036279 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:30.036282 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:30.036311 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:30.038160 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:30.038664 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:30.038668 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:30.038670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:30.038780 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:30.039140 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:30.039145 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:30.039150 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:30.039432 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:30.039553 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:30.040034 (+ 481us) server_negotiation.cc:299] Negotiation successful
0811 11:45:30.040190 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 11:45:30.041121 29113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:30.027046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.65:41091)
0811 11:45:30.027582 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:30.027636 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:30.028956 (+ 1320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:30.029461 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:30.029467 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:30.029844 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:30.030339 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:30.030354 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.031494 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.031499 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:30.032799 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:30.032809 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.033493 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.033496 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:30.033663 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:30.034292 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:30.034308 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:30.036111 (+ 1803us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:30.038282 (+ 2171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:30.038287 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:30.038298 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:30.038557 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:30.038890 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:30.038892 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:30.038893 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:30.039023 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:30.039544 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:30.039549 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:30.039772 (+ 223us) client_negotiation.cc:769] Sending connection context
0811 11:45:30.039943 (+ 171us) client_negotiation.cc:240] Negotiation successful
0811 11:45:30.040191 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":162,"threads_started":1}
I20260811 11:45:30.042659 29111 heartbeater.cc:347] Connected to a master server at 127.20.244.126:33249
WARNING: no policy specified for oryx/127.20.244.66@KRBTEST.COM; defaulting to no policy
I20260811 11:45:30.042943 29111 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:30.043481 29111 heartbeater.cc:511] Master 127.20.244.126:33249 requested a full tablet report, sending...
I20260811 11:45:30.045068 28874 ts_manager.cc:194] Registered new tserver with Master: 09025679fb854a8dadd0ff0e1952e5f9 (127.20.244.65:45231)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.244.66@KRBTEST.COM" created.
I20260811 11:45:30.046512 28874 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:41091
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.244.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.66.keytab.
Entry for principal oryx/127.20.244.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.66.keytab.
I20260811 11:45:30.062626 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:33249
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.66.keytab
--principal=oryx/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:38121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:30.174958 29116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:30.175256 29116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:30.175309 29116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:30.179466 29116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:30.179517 29116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:30.179572 29116 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:45:30.184597 29116 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:38121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.66.keytab
--principal=oryx/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:33249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29116
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:30.185567 29116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:30.186616 29116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:30.196408 29122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:30.196383 29123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:30.196343 29126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:30.196602 29116 server_base.cc:1034] running on GCE node
I20260811 11:45:30.197124 29116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:30.197831 29116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:30.199016 29116 hybrid_clock.cc:648] HybridClock initialized: now 1786448730199003 us; error 24 us; skew 500 ppm
Aug 11 11:45:30 dist-test-slave-vkjp krb5kdc[28819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448730, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:30.201954 29116 init.cc:377] Logged in from keytab as oryx/127.20.244.66@KRBTEST.COM (short username oryx)
I20260811 11:45:30.202785 29116 webserver.cc:460] Webserver started at http://127.20.244.66:42551/ using document root <none> and password file <none>
I20260811 11:45:30.203379 29116 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:30.203444 29116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:30.203611 29116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:30.205614 29116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "f902f72b2c094219b426f4a0cd80529b"
format_stamp: "Formatted at 2026-08-11 11:45:30 on dist-test-slave-vkjp"
server_key: "ad49ba2e105952a704aaa1a4e1e7233b"
server_key_iv: "39383628b5b98c60b3e65bba08e890eb"
server_key_version: "encryptionkey@0"
I20260811 11:45:30.206140 29116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "f902f72b2c094219b426f4a0cd80529b"
format_stamp: "Formatted at 2026-08-11 11:45:30 on dist-test-slave-vkjp"
server_key: "ad49ba2e105952a704aaa1a4e1e7233b"
server_key_iv: "39383628b5b98c60b3e65bba08e890eb"
server_key_version: "encryptionkey@0"
I20260811 11:45:30.209966 29116 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 11:45:30.212448 29133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:30.213708 29116 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 11:45:30.213804 29116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "f902f72b2c094219b426f4a0cd80529b"
format_stamp: "Formatted at 2026-08-11 11:45:30 on dist-test-slave-vkjp"
server_key: "ad49ba2e105952a704aaa1a4e1e7233b"
server_key_iv: "39383628b5b98c60b3e65bba08e890eb"
server_key_version: "encryptionkey@0"
I20260811 11:45:30.213943 29116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:30.227322 29116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:30.230681 29116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:30.230878 29116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:30.231521 29116 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:30.232318 29116 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:30.232367 29116 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:30.232407 29116 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:30.232422 29116 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:30.241317 29116 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:44491
I20260811 11:45:30.241442 29275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:44491 every 8 connection(s)
I20260811 11:45:30.242347 29116 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:45:30.249557 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 29116
I20260811 11:45:30.249658 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:45:30.249997 21457 external_mini_cluster.cc:1428] Setting key 876390043a73788d2e808b8ecbcd0911
Aug 11 11:45:30 dist-test-slave-vkjp krb5kdc[28819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448730, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM
I20260811 11:45:30.257323 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:30.244414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:48629 (local address 127.20.244.126:33249)
0811 11:45:30.244564 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:30.244568 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:30.245483 (+ 915us) server_negotiation.cc:407] Connection header received
0811 11:45:30.246806 (+ 1323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:30.246809 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:30.246863 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:30.246948 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:30.248185 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.248764 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.250026 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.250351 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.250488 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:30.253362 (+ 2874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:30.253366 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:30.253369 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:30.253401 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:30.254946 (+ 1545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:30.255600 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:30.255603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:30.255605 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:30.255687 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:30.256117 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:30.256120 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:30.256121 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:30.256296 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:30.256369 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:30.257087 (+ 718us) server_negotiation.cc:299] Negotiation successful
0811 11:45:30.257199 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 11:45:30.258534 29279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:30.244784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.66:48629)
0811 11:45:30.245296 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:30.245339 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:30.246581 (+ 1242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:30.247192 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:30.247199 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:30.247574 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:30.248045 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:30.248058 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.248884 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.248887 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:30.249901 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:30.249911 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.250532 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.250536 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:30.250747 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:30.251424 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:30.251445 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:30.253179 (+ 1734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:30.255107 (+ 1928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:30.255117 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:30.255134 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:30.255496 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:30.255798 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:30.255804 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:30.255809 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:30.256000 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:30.256401 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:30.256410 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:30.256768 (+ 358us) client_negotiation.cc:769] Sending connection context
0811 11:45:30.256998 (+ 230us) client_negotiation.cc:240] Negotiation successful
0811 11:45:30.257379 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":131,"threads_started":1}
I20260811 11:45:30.259855 29276 heartbeater.cc:347] Connected to a master server at 127.20.244.126:33249
I20260811 11:45:30.260110 29276 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:30.260598 29276 heartbeater.cc:511] Master 127.20.244.126:33249 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.20.244.67@KRBTEST.COM; defaulting to no policy
I20260811 11:45:30.261698 28874 ts_manager.cc:194] Registered new tserver with Master: f902f72b2c094219b426f4a0cd80529b (127.20.244.66:44491)
I20260811 11:45:30.262266 28874 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:48629
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.244.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.244.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.67.keytab.
Entry for principal oryx/127.20.244.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.67.keytab.
I20260811 11:45:30.282526 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:33249
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.67.keytab
--principal=oryx/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:38121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:30.398000 29282 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:30.398321 29282 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:30.398413 29282 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:30.402683 29282 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:30.402778 29282 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:30.402868 29282 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:45:30.408345 29282 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:38121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.67.keytab
--principal=oryx/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:33249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29282
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:30.409493 29282 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:30.410554 29282 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:30.421075 29291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:30.421090 29289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:30.421125 29288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:30.421350 29282 server_base.cc:1034] running on GCE node
I20260811 11:45:30.421785 29282 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:30.422420 29282 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:30.423612 29282 hybrid_clock.cc:648] HybridClock initialized: now 1786448730423587 us; error 42 us; skew 500 ppm
Aug 11 11:45:30 dist-test-slave-vkjp krb5kdc[28819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448730, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:30.426657 29282 init.cc:377] Logged in from keytab as oryx/127.20.244.67@KRBTEST.COM (short username oryx)
I20260811 11:45:30.427644 29282 webserver.cc:460] Webserver started at http://127.20.244.67:38717/ using document root <none> and password file <none>
I20260811 11:45:30.428181 29282 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:30.428241 29282 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:30.428421 29282 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:30.430501 29282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "c261356616aa44aca005f79e87745598"
format_stamp: "Formatted at 2026-08-11 11:45:30 on dist-test-slave-vkjp"
server_key: "e7ec08c76cde34e99235ced7f4ba3873"
server_key_iv: "d3b24acb3a553f8f1ad3195da3d09ccc"
server_key_version: "encryptionkey@0"
I20260811 11:45:30.431039 29282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "c261356616aa44aca005f79e87745598"
format_stamp: "Formatted at 2026-08-11 11:45:30 on dist-test-slave-vkjp"
server_key: "e7ec08c76cde34e99235ced7f4ba3873"
server_key_iv: "d3b24acb3a553f8f1ad3195da3d09ccc"
server_key_version: "encryptionkey@0"
I20260811 11:45:30.434944 29282 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 11:45:30.437743 29299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:30.439050 29282 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:30.439217 29282 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "c261356616aa44aca005f79e87745598"
format_stamp: "Formatted at 2026-08-11 11:45:30 on dist-test-slave-vkjp"
server_key: "e7ec08c76cde34e99235ced7f4ba3873"
server_key_iv: "d3b24acb3a553f8f1ad3195da3d09ccc"
server_key_version: "encryptionkey@0"
I20260811 11:45:30.439364 29282 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:30.455688 29282 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:30.458837 29282 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:30.458997 29282 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:30.459673 29282 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:30.460490 29282 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:30.460537 29282 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:30.460577 29282 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:30.460592 29282 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:30.469805 29282 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:32783
I20260811 11:45:30.469835 29443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:32783 every 8 connection(s)
I20260811 11:45:30.470825 29282 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:45:30.480187 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 29282
I20260811 11:45:30.480332 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:45:30.480654 21457 external_mini_cluster.cc:1428] Setting key cdc622ed46f41ec3b81fe4fdde901259
Aug 11 11:45:30 dist-test-slave-vkjp krb5kdc[28819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448730, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM
I20260811 11:45:30.485627 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:30.472867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:45931 (local address 127.20.244.126:33249)
0811 11:45:30.473016 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:30.473025 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:30.473749 (+ 724us) server_negotiation.cc:407] Connection header received
0811 11:45:30.475227 (+ 1478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:30.475230 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:30.475294 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:30.475382 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:30.476776 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.477353 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.478520 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.478757 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.478880 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:30.481858 (+ 2978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:30.481861 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:30.481864 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:30.481888 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:30.483523 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:30.484049 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:30.484052 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:30.484054 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:30.484160 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:30.484489 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:30.484492 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:30.484493 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:30.484705 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:30.484788 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:30.485374 (+ 586us) server_negotiation.cc:299] Negotiation successful
0811 11:45:30.485495 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 11:45:30.486433 29446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:30.473140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.67:45931)
0811 11:45:30.473584 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:30.473630 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:30.474940 (+ 1310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:30.475570 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:30.475576 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:30.476002 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:30.476604 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:30.476622 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.477482 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.477486 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:30.478389 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:30.478399 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.478917 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.478921 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:30.479122 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:30.479713 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:30.479729 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:30.481669 (+ 1940us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:30.483629 (+ 1960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:30.483635 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:30.483647 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:30.483934 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:30.484253 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:30.484256 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:30.484257 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:30.484401 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:30.484806 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:30.484812 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:30.485075 (+ 263us) client_negotiation.cc:769] Sending connection context
0811 11:45:30.485237 (+ 162us) client_negotiation.cc:240] Negotiation successful
0811 11:45:30.485505 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":122,"threads_started":1}
I20260811 11:45:30.487717 29444 heartbeater.cc:347] Connected to a master server at 127.20.244.126:33249
I20260811 11:45:30.487957 29444 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:30.488420 29444 heartbeater.cc:511] Master 127.20.244.126:33249 requested a full tablet report, sending...
I20260811 11:45:30.489459 28874 ts_manager.cc:194] Registered new tserver with Master: c261356616aa44aca005f79e87745598 (127.20.244.67:32783)
I20260811 11:45:30.490031 28874 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:45931
I20260811 11:45:30.495190 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.20.244.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.244.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.244.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.125.keytab.
Entry for principal oryx/127.20.244.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.125.keytab.
I20260811 11:45:30.526980 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.125:37843
--webserver_interface=127.20.244.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.125.keytab
--principal=oryx/127.20.244.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:38121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:33249,127.20.244.125:37843
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:30.642786 29450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:30.643136 29450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:30.643229 29450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:30.647356 29450 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:30.647439 29450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:30.647476 29450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:30.647516 29450 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:30.647550 29450 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:45:30.653002 29450 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:38121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:33249,127.20.244.125:37843
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.125.keytab
--principal=oryx/127.20.244.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.125:37843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.244.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
W20260811 11:45:30.653265 29450 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.20.244.126:33249,127.20.244.125:37843'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 11:45:30.654244 29450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:30.655536 29450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:30.664237 29461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:30.664286 29459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:30.664484 29450 server_base.cc:1034] running on GCE node
W20260811 11:45:30.664232 29457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:30.665084 29450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:30.666193 29450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:30.667416 29450 hybrid_clock.cc:648] HybridClock initialized: now 1786448730667401 us; error 33 us; skew 500 ppm
Aug 11 11:45:30 dist-test-slave-vkjp krb5kdc[28819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448730, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:30.670295 29450 init.cc:377] Logged in from keytab as oryx/127.20.244.125@KRBTEST.COM (short username oryx)
I20260811 11:45:30.671272 29450 webserver.cc:460] Webserver started at http://127.20.244.125:46261/ using document root <none> and password file <none>
I20260811 11:45:30.671830 29450 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:30.671922 29450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:30.672155 29450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:30.674276 29450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/data/instance:
uuid: "069975cd170f4e85883ae295691c6046"
format_stamp: "Formatted at 2026-08-11 11:45:30 on dist-test-slave-vkjp"
server_key: "28a33d44d7b814498973e70da3abf6f6"
server_key_iv: "e77e0815c794197b76f738bebbe6327f"
server_key_version: "encryptionkey@0"
I20260811 11:45:30.674875 29450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/wal/instance:
uuid: "069975cd170f4e85883ae295691c6046"
format_stamp: "Formatted at 2026-08-11 11:45:30 on dist-test-slave-vkjp"
server_key: "28a33d44d7b814498973e70da3abf6f6"
server_key_iv: "e77e0815c794197b76f738bebbe6327f"
server_key_version: "encryptionkey@0"
I20260811 11:45:30.678768 29450 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 11:45:30.681197 29470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:30.682498 29450 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:30.682632 29450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/wal
uuid: "069975cd170f4e85883ae295691c6046"
format_stamp: "Formatted at 2026-08-11 11:45:30 on dist-test-slave-vkjp"
server_key: "28a33d44d7b814498973e70da3abf6f6"
server_key_iv: "e77e0815c794197b76f738bebbe6327f"
server_key_version: "encryptionkey@0"
I20260811 11:45:30.682740 29450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:30.702589 29450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:30.705904 29450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:30.706107 29450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:30.713421 29450 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.125:37843
I20260811 11:45:30.713698 29531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.125:37843 every 8 connection(s)
I20260811 11:45:30.714525 29450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/data/info.pb
I20260811 11:45:30.717453 29532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:30.721402 29532 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:45:30.724594 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 29450
Aug 11 11:45:30 dist-test-slave-vkjp krb5kdc[28819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448730, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.125@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM
Aug 11 11:45:30 dist-test-slave-vkjp krb5kdc[28819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448729, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.244.125@KRBTEST.COM
I20260811 11:45:30.736352 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:30.723307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56830 (local address 127.20.244.126:33249)
0811 11:45:30.723464 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:30.723469 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:30.724303 (+ 834us) server_negotiation.cc:407] Connection header received
0811 11:45:30.725464 (+ 1161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:30.725467 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:30.725529 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:30.725639 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:30.727104 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.727636 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.728676 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.728921 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.729036 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:30.732060 (+ 3024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:30.732064 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:30.732066 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:30.732097 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:30.733934 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:30.734520 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:30.734524 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:30.734525 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:30.734624 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:30.735031 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:30.735034 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:30.735035 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:30.735351 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:30.735478 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:30.736017 (+ 539us) server_negotiation.cc:299] Negotiation successful
0811 11:45:30.736167 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 11:45:30.737260 29534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:30.723721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.0.0.1:56830)
0811 11:45:30.724156 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:30.724198 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:30.725244 (+ 1046us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:30.725813 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:30.725822 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:30.726308 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:30.726938 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:30.726951 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.727774 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.727780 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:30.728549 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:30.728558 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.729075 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.729079 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:30.729440 (+ 361us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:30.730197 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:30.730221 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:30.731910 (+ 1689us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:30.734059 (+ 2149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:30.734067 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:30.734074 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:30.734413 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:30.734719 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:30.734724 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:30.734729 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:30.734925 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:30.735488 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:30.735494 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:30.735742 (+ 248us) client_negotiation.cc:769] Sending connection context
0811 11:45:30.735951 (+ 209us) client_negotiation.cc:240] Negotiation successful
0811 11:45:30.736293 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"mutex_wait_us":84,"thread_start_us":127,"threads_started":1}
I20260811 11:45:30.737265 29536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:30.725557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52326 (local address 127.20.244.125:37843)
0811 11:45:30.725894 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:30.725905 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:30.726040 (+ 135us) server_negotiation.cc:407] Connection header received
0811 11:45:30.726120 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:30.726125 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:30.726320 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:30.726495 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:30.727277 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.728123 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.728987 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.729554 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.729673 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:30.732643 (+ 2970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:30.732650 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:30.732661 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:30.732692 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:30.734528 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:30.735035 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:30.735041 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:30.735043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:30.735142 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:30.735417 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:30.735423 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:30.735427 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:30.735731 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:30.735889 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:30.736150 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 11:45:30.736378 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":155,"server-negotiator.queue_time_us":247,"thread_start_us":97,"threads_started":1}
I20260811 11:45:30.738755 29532 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 11:45:30 dist-test-slave-vkjp krb5kdc[28819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448730, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.125@KRBTEST.COM for oryx/127.20.244.125@KRBTEST.COM
I20260811 11:45:30.746825 29536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:30.739408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52334 (local address 127.20.244.125:37843)
0811 11:45:30.739528 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:30.739532 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:30.739667 (+ 135us) server_negotiation.cc:407] Connection header received
0811 11:45:30.739790 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:30.739793 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:30.739830 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:30.739907 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:30.740266 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.740754 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.741491 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.741710 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.741815 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:30.743787 (+ 1972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:30.743789 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:30.743791 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:30.743809 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:30.745162 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:30.745658 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:30.745661 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:30.745662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:30.745730 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:30.746002 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:30.746004 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:30.746005 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:30.746156 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:30.746229 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:30.746559 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 11:45:30.746680 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":51}
I20260811 11:45:30.746827 29534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:30.739305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:37843 (local address 127.0.0.1:52334)
0811 11:45:30.739601 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:30.739611 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:30.739703 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:30.739931 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:30.739933 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:30.740085 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:30.740160 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:30.740165 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.740874 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.740877 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:30.741377 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:30.741384 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.741815 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.741818 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:30.741917 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:30.742310 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:30.742320 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:30.743629 (+ 1309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:30.745322 (+ 1693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:30.745325 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:30.745327 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:30.745556 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:30.745824 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:30.745826 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:30.745828 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:30.745916 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:30.746280 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:30.746282 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:30.746370 (+ 88us) client_negotiation.cc:769] Sending connection context
0811 11:45:30.746508 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 11:45:30.746630 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241}
I20260811 11:45:30.750382 29532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046: Bootstrap starting.
I20260811 11:45:30.752745 29532 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:30.753494 29532 log.cc:824] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:30.755488 29532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046: No bootstrap required, opened a new log
I20260811 11:45:30.758365 29532 raft_consensus.cc:348] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } }
I20260811 11:45:30.758554 29532 raft_consensus.cc:374] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:30.758611 29532 raft_consensus.cc:729] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069975cd170f4e85883ae295691c6046, State: Initialized, Role: FOLLOWER
I20260811 11:45:30.759058 29532 consensus_queue.cc:260] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } }
I20260811 11:45:30.759567 29538 sys_catalog.cc:455] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } } }
I20260811 11:45:30.759686 29538 sys_catalog.cc:458] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:45:30.760321 29532 sys_catalog.cc:564] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 11:45:30.765269 29550 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:45:30.765360 29550 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:45:30.767851 29450 master_runner.cc:428] Detected that this master 069975cd170f4e85883ae295691c6046 is joining an existing cluster
I20260811 11:45:30.767925 29450 master_runner.cc:432] Initiating AddMaster RPC to add 127.20.244.125:37843
I20260811 11:45:30.780097 29536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:30.770350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52336 (local address 127.20.244.125:37843)
0811 11:45:30.770446 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:30.770450 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:30.770584 (+ 134us) server_negotiation.cc:407] Connection header received
0811 11:45:30.770685 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:30.770691 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:30.770730 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:30.770804 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:30.771459 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.772207 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.773424 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.773766 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.773943 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:30.775426 (+ 1483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:30.775431 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:30.775434 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:30.775469 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:30.777651 (+ 2182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:30.778322 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:30.778325 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:30.778326 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:30.778414 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:30.779034 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:30.779041 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:30.779043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:30.779304 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:30.779431 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:30.779753 (+ 322us) server_negotiation.cc:299] Negotiation successful
0811 11:45:30.779930 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":119,"server-negotiator.queue_time_us":32}
I20260811 11:45:30.780134 29558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:30.770010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:37843 (local address 127.0.0.1:52336)
0811 11:45:30.770503 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:30.770513 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:30.770616 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:30.770851 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:30.770854 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:30.771129 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:30.771286 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:30.771299 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.772329 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.772332 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:30.773265 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:30.773277 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.773954 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.773959 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:30.774133 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:30.774765 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:30.774780 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:30.775267 (+ 487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:30.777768 (+ 2501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:30.777775 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:30.777779 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:30.778086 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:30.778802 (+ 716us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:30.778808 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:30.778811 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:30.778923 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:30.779419 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:30.779422 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:30.779530 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 11:45:30.779679 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 11:45:30.779859 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"mutex_wait_us":20,"thread_start_us":112,"threads_started":1}
I20260811 11:45:30.781602 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:30.770287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56840 (local address 127.20.244.126:33249)
0811 11:45:30.770428 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:30.770433 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:30.770449 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:45:30.770492 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:30.770495 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:30.770542 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:30.770623 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:30.771368 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.772208 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.774526 (+ 2318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.774874 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.775038 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:30.777482 (+ 2444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:30.777487 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:30.777490 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:30.777519 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:30.779407 (+ 1888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:30.779901 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:30.779906 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:30.779909 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:30.780012 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:30.780619 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:30.780623 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:30.780625 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:30.780847 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:30.780949 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:30.781319 (+ 370us) server_negotiation.cc:299] Negotiation successful
0811 11:45:30.781452 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 11:45:30.782099 29557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:30.769937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.0.0.1:56840)
0811 11:45:30.770241 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:30.770257 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:30.770359 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:30.770728 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:30.770731 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:30.771034 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:30.771237 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:30.771244 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.773424 (+ 2180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.773428 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:30.774390 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:30.774401 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.775039 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.775044 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:30.775181 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:30.776628 (+ 1447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:30.776650 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:30.777314 (+ 664us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:30.779496 (+ 2182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:30.779499 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:30.779501 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:30.779779 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:30.780158 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:30.780161 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:30.780163 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:30.780456 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:30.781012 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:30.781016 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:30.781124 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 11:45:30.781795 (+ 671us) client_negotiation.cc:240] Negotiation successful
0811 11:45:30.781935 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"mutex_wait_us":56,"thread_start_us":110,"threads_started":1}
Aug 11 11:45:30 dist-test-slave-vkjp krb5kdc[28819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448729, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.126@KRBTEST.COM for oryx/127.20.244.125@KRBTEST.COM
I20260811 11:45:30.797152 29536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:30.787021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52340 (local address 127.20.244.125:37843)
0811 11:45:30.787202 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:30.787205 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:30.787955 (+ 750us) server_negotiation.cc:407] Connection header received
0811 11:45:30.788118 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:30.788121 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:30.788166 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:30.788242 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:30.789023 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.789491 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.790758 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.791074 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.791202 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:30.793846 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:30.793849 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:30.793852 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:30.793881 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:30.795375 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:30.795861 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:30.795866 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:30.795868 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:30.795947 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:30.796230 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:30.796235 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:30.796236 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:30.796416 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:30.796519 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:30.796881 (+ 362us) server_negotiation.cc:299] Negotiation successful
0811 11:45:30.797003 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260811 11:45:30.797184 29559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:30.786982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:37843 (local address 127.0.0.1:52340)
0811 11:45:30.787815 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:30.787867 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:30.787999 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:30.788298 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:30.788304 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:30.788750 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:30.788887 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:30.788895 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.789598 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.789602 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:30.790591 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:30.790603 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.791213 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.791217 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:30.791338 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:30.791903 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:30.791918 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:30.793694 (+ 1776us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:30.795488 (+ 1794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:30.795498 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:30.795504 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:30.795747 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:30.796042 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:30.796045 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:30.796047 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:30.796138 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:30.796537 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:30.796545 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:30.796669 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 11:45:30.796828 (+ 159us) client_negotiation.cc:240] Negotiation successful
0811 11:45:30.797024 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":671,"thread_start_us":130,"threads_started":1}
I20260811 11:45:30.798717 28874 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.20.244.125:37843: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "069975cd170f4e85883ae295691c6046"
member_type: NON_VOTER
last_known_addr {
host: "127.20.244.125"
port: 37843
}
attrs {
promote: true
}
}
dest_uuid: "dc3a5b075c0b4be29c9047591ab3d38c"
cas_config_opid_index: -1
I20260811 11:45:30.799449 28874 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: NON_VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: true } }
WARNING: no policy specified for oryx/127.20.244.124@KRBTEST.COM; defaulting to no policy
I20260811 11:45:30.801419 29562 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 069975cd170f4e85883ae295691c6046 (127.20.244.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: NON_VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: true } } }
I20260811 11:45:30.802296 29504 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:30.803967 29562 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.20.244.125:37843
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.244.124@KRBTEST.COM" created.
I20260811 11:45:30.804507 29450 master.cc:537] Master@127.20.244.125:37843 shutting down...
I20260811 11:45:30.804567 29504 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 1 FOLLOWER]: Refusing update from remote peer dc3a5b075c0b4be29c9047591ab3d38c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 11:45:30.806954 29564 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: NON_VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:30.808808 29566 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: NON_VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: true } } }
I20260811 11:45:30.808926 29566 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [sys.catalog]: This master's current role is: LEADER
W20260811 11:45:30.809268 28853 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 11:45:30.810267 28853 consensus_peers.cc:487] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c -> Peer 069975cd170f4e85883ae295691c6046 (127.20.244.125:37843): Couldn't send request to peer 069975cd170f4e85883ae295691c6046. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 11:45:30.811270 29450 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:30.811558 29450 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:30.811685 29450 tablet_replica.cc:330] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046: stopping tablet replica
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.244.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.124.keytab.
Entry for principal oryx/127.20.244.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.124.keytab.
I20260811 11:45:30.825758 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.124:44973
--webserver_interface=127.20.244.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.124.keytab
--principal=oryx/127.20.244.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:38121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:33249,127.20.244.125:37843,127.20.244.124:44973
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:45:30.827694 29450 master.cc:552] Master@127.20.244.125:37843 shutdown complete.
I20260811 11:45:30.827768 29450 master_runner.cc:305] Clearing existing system tablet
I20260811 11:45:30.828038 29450 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:30.828100 29450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:30.829599 29450 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 11:45:30.830644 29574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:30.830888 29450 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:30.831010 29450 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:30.831045 29450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/wal
uuid: "069975cd170f4e85883ae295691c6046"
format_stamp: "Formatted at 2026-08-11 11:45:30 on dist-test-slave-vkjp"
server_key: "28a33d44d7b814498973e70da3abf6f6"
server_key_iv: "e77e0815c794197b76f738bebbe6327f"
server_key_version: "encryptionkey@0"
I20260811 11:45:30.833437 29450 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:30.836054 29450 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 11:45:30.836158 29450 log.cc:1196] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 11:45:30.836580 29450 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046: Deleting consensus metadata
I20260811 11:45:30.836795 29450 master_runner.cc:315] Copying system tablet from 127.20.244.126:33249
I20260811 11:45:30.838266 29450 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046: tablet copy: Beginning tablet copy session from remote peer at address 127.20.244.126:33249
I20260811 11:45:30.852157 29584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:30.839015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.0.0.1:56850)
0811 11:45:30.842843 (+ 3828us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:30.842865 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:30.843368 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:30.843770 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:30.843774 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:30.844002 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:30.844147 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:30.844153 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.845328 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.845332 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:30.846270 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:30.846280 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.846944 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.846948 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:30.847054 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:30.847714 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:30.847729 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:30.848175 (+ 446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:30.850340 (+ 2165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:30.850343 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:30.850346 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:30.850630 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:30.850955 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:30.850958 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:30.850960 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:30.851056 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:30.851581 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:30.851584 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:30.851692 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 11:45:30.851803 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 11:45:30.851948 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3690,"thread_start_us":111,"threads_started":1}
I20260811 11:45:30.852208 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:30.839196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56850 (local address 127.20.244.126:33249)
0811 11:45:30.839340 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:30.839346 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:30.842994 (+ 3648us) server_negotiation.cc:407] Connection header received
0811 11:45:30.843503 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:30.843506 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:30.843571 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:30.843681 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:30.844275 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.845194 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.846402 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:30.846808 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:30.846931 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:30.848341 (+ 1410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:30.848345 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:30.848349 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:30.848379 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:30.850210 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:30.850735 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:30.850739 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:30.850741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:30.850847 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:30.851212 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:30.851216 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:30.851218 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:30.851466 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:30.851582 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:30.851899 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 11:45:30.852031 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 11:45:30.853286 28898 tablet_copy_service.cc:140] P dc3a5b075c0b4be29c9047591ab3d38c: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 069975cd170f4e85883ae295691c6046 ({username='oryx', principal='oryx/127.20.244.125@KRBTEST.COM'} at 127.0.0.1:56850)
I20260811 11:45:30.853478 28898 tablet_copy_service.cc:161] P dc3a5b075c0b4be29c9047591ab3d38c: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 069975cd170f4e85883ae295691c6046 at {username='oryx', principal='oryx/127.20.244.125@KRBTEST.COM'} at 127.0.0.1:56850: session id = 069975cd170f4e85883ae295691c6046-00000000000000000000000000000000
I20260811 11:45:30.855511 28898 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 11:45:30.857462 29450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 11:45:30.860224 29450 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046: tablet copy: Starting download of 0 data blocks...
I20260811 11:45:30.860440 29450 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046: tablet copy: Starting download of 1 WAL segments...
I20260811 11:45:30.862577 29450 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 11:45:30.864602 28898 tablet_copy_service.cc:342] P dc3a5b075c0b4be29c9047591ab3d38c: Request end of tablet copy session 069975cd170f4e85883ae295691c6046-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.20.244.125@KRBTEST.COM'} at 127.0.0.1:56850
I20260811 11:45:30.864733 28898 tablet_copy_service.cc:433] P dc3a5b075c0b4be29c9047591ab3d38c: ending tablet copy session 069975cd170f4e85883ae295691c6046-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 069975cd170f4e85883ae295691c6046
I20260811 11:45:30.872695 29450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:30.875267 29589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:30.875576 29585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:30.875838 29586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:30.876783 29450 server_base.cc:1034] running on GCE node
I20260811 11:45:30.877100 29450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:30.877461 29450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:30.878609 29450 hybrid_clock.cc:648] HybridClock initialized: now 1786448730878596 us; error 30 us; skew 500 ppm
Aug 11 11:45:30 dist-test-slave-vkjp krb5kdc[28819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448730, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:30.880445 29450 init.cc:377] Logged in from keytab as oryx/127.20.244.125@KRBTEST.COM (short username oryx)
I20260811 11:45:30.880946 29450 webserver.cc:460] Webserver started at http://127.20.244.125:34317/ using document root <none> and password file <none>
I20260811 11:45:30.881170 29450 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:30.881209 29450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:30.882666 29450 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:30.883919 29597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:30.884194 29450 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:30.884315 29450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/wal
uuid: "069975cd170f4e85883ae295691c6046"
format_stamp: "Formatted at 2026-08-11 11:45:30 on dist-test-slave-vkjp"
server_key: "28a33d44d7b814498973e70da3abf6f6"
server_key_iv: "e77e0815c794197b76f738bebbe6327f"
server_key_version: "encryptionkey@0"
I20260811 11:45:30.884574 29450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260811 11:45:30.951685 29571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:30.951978 29571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:30.952066 29571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:30.956286 29571 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:30.956377 29571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:30.956416 29571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:30.956439 29571 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:30.956468 29571 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:45:30.957136 29450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:30.959408 29450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:30.963471 29571 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:38121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:33249,127.20.244.125:37843,127.20.244.124:44973
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.124.keytab
--principal=oryx/127.20.244.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.124:44973
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.244.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:30.964757 29571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:30.964840 29450 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.125:37843
I20260811 11:45:30.965008 29670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.125:37843 every 8 connection(s)
I20260811 11:45:30.965582 29450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-1/data/info.pb
I20260811 11:45:30.965986 29571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:45:30.967553 29671 sys_catalog.cc:263] Verifying existing consensus state
I20260811 11:45:30.968619 29671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046: Bootstrap starting.
W20260811 11:45:30.976471 29678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:30.976624 29675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:30.976754 29676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:30.977833 29571 server_base.cc:1034] running on GCE node
I20260811 11:45:30.978463 29571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:30.979943 29571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:30.980701 29671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:45:30.981009 29671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046: Bootstrap complete.
I20260811 11:45:30.981144 29571 hybrid_clock.cc:648] HybridClock initialized: now 1786448730981139 us; error 37 us; skew 500 ppm
I20260811 11:45:30.981573 29671 raft_consensus.cc:348] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: NON_VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: true } }
I20260811 11:45:30.981684 29671 raft_consensus.cc:729] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 069975cd170f4e85883ae295691c6046, State: Initialized, Role: LEARNER
I20260811 11:45:30.981801 29671 consensus_queue.cc:260] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: NON_VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: true } }
I20260811 11:45:30.982120 29682 sys_catalog.cc:455] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: NON_VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: true } } }
I20260811 11:45:30.982229 29682 sys_catalog.cc:458] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [sys.catalog]: This master's current role is: LEARNER
I20260811 11:45:30.982293 29671 sys_catalog.cc:564] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 11:45:30 dist-test-slave-vkjp krb5kdc[28819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448730, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:30.984366 29571 init.cc:377] Logged in from keytab as oryx/127.20.244.124@KRBTEST.COM (short username oryx)
I20260811 11:45:30.985188 29694 catalog_manager.cc:1259] Loaded cluster ID: 099b90cae7d948e6920e7219d648152b
I20260811 11:45:30.985240 29694 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046: loading cluster ID for follower catalog manager: success
I20260811 11:45:30.985466 29571 webserver.cc:460] Webserver started at http://127.20.244.124:33727/ using document root <none> and password file <none>
I20260811 11:45:30.986057 29571 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:30.986119 29571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:30.986279 29571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:30.987154 29694 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046: acquiring CA information for follower catalog manager: success
I20260811 11:45:30.988582 29694 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 11:45:30.988638 29571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/data/instance:
uuid: "0977a806ce7e43ccbc582c3022abedcf"
format_stamp: "Formatted at 2026-08-11 11:45:30 on dist-test-slave-vkjp"
server_key: "a457980c52fba3af09583d1f3d397e66"
server_key_iv: "8a19a6f4c4b4cdb3af1bf94474e30c66"
server_key_version: "encryptionkey@0"
I20260811 11:45:30.989136 29571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/wal/instance:
uuid: "0977a806ce7e43ccbc582c3022abedcf"
format_stamp: "Formatted at 2026-08-11 11:45:30 on dist-test-slave-vkjp"
server_key: "a457980c52fba3af09583d1f3d397e66"
server_key_iv: "8a19a6f4c4b4cdb3af1bf94474e30c66"
server_key_version: "encryptionkey@0"
I20260811 11:45:30.992982 29571 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 11:45:30.995877 29701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:30.997248 29571 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:45:30.997357 29571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/wal
uuid: "0977a806ce7e43ccbc582c3022abedcf"
format_stamp: "Formatted at 2026-08-11 11:45:30 on dist-test-slave-vkjp"
server_key: "a457980c52fba3af09583d1f3d397e66"
server_key_iv: "8a19a6f4c4b4cdb3af1bf94474e30c66"
server_key_version: "encryptionkey@0"
I20260811 11:45:30.997457 29571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:31.016063 29571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:31.019655 29571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:31.019824 29571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:31.028002 29571 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.124:44973
I20260811 11:45:31.028306 29765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.124:44973 every 8 connection(s)
I20260811 11:45:31.029136 29571 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/data/info.pb
I20260811 11:45:31.031847 29767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:31.033488 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 29571
I20260811 11:45:31.035887 29767 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 11:45:31 dist-test-slave-vkjp krb5kdc[28819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448729, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.244.124@KRBTEST.COM
Aug 11 11:45:31 dist-test-slave-vkjp krb5kdc[28819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448730, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.124@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM
I20260811 11:45:31.048568 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.038132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56854 (local address 127.20.244.126:33249)
0811 11:45:31.038258 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.038263 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.038468 (+ 205us) server_negotiation.cc:407] Connection header received
0811 11:45:31.038606 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.038609 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.038664 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.038742 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.039550 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.040341 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.041555 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.041844 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.041976 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.044954 (+ 2978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.044958 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.044960 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.044987 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.046561 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.047196 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.047200 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.047201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.047287 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.047567 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.047569 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.047570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.047769 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.047867 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.048296 (+ 429us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.048444 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 11:45:31.048856 29111 heartbeater.cc:503] Master 127.20.244.126:33249 was elected leader, sending a full tablet report...
I20260811 11:45:31.049461 29771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.037915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.0.0.1:56854)
0811 11:45:31.038332 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.038377 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.038506 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.038821 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.038826 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.039272 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:31.039418 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.039428 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.040482 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.040485 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.041435 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.041444 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.042066 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.042071 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.042163 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.042716 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:31.042732 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:31.044796 (+ 2064us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:31.046666 (+ 1870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.046673 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.046682 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.047066 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.047382 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.047385 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.047387 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.047469 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.047884 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:31.047890 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:31.048047 (+ 157us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.048179 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.048503 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":122,"spinlock_wait_cycles":3840,"thread_start_us":166,"threads_started":1}
I20260811 11:45:31.049467 29770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.035023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49408 (local address 127.20.244.124:44973)
0811 11:45:31.035486 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.035502 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.035537 (+ 35us) server_negotiation.cc:407] Connection header received
0811 11:45:31.036175 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.036192 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.036534 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.036916 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.037859 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.039381 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.040603 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.041277 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.041429 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.044209 (+ 2780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.044214 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.044224 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.044267 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.046160 (+ 1893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.046667 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.046673 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.046678 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.046882 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.047181 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.047185 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.047187 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.047683 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.047864 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.048133 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.048468 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":312,"spinlock_wait_cycles":1280,"thread_start_us":130,"threads_started":1}
I20260811 11:45:31.050626 29767 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 11:45:31 dist-test-slave-vkjp krb5kdc[28819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448730, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.124@KRBTEST.COM for oryx/127.20.244.125@KRBTEST.COM
I20260811 11:45:31.058965 29771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.051076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:37843 (local address 127.0.0.1:52356)
0811 11:45:31.051219 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.051235 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.051308 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.051887 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.051890 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.052040 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:31.052126 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.052131 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.053017 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.053020 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.053527 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.053534 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.054006 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.054009 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.054083 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.054537 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:31.054556 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:31.055761 (+ 1205us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:31.057307 (+ 1546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.057310 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.057312 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.057512 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.057797 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.057801 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.057803 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.057895 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.058445 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:31.058448 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:31.058550 (+ 102us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.058662 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.058799 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 11:45:31.059026 29772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.051232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52356 (local address 127.20.244.125:37843)
0811 11:45:31.051521 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.051524 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.051535 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:45:31.051570 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.051572 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.051631 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.051733 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.052234 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.052918 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.053621 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.053880 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.053963 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.055908 (+ 1945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.055911 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.055913 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.055935 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.057190 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.057614 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.057618 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.057620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.057701 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.057986 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.057991 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.057993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.058173 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.058459 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.058734 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.058879 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":102,"threads_started":1}
I20260811 11:45:31.059800 29767 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 11:45:31 dist-test-slave-vkjp krb5kdc[28819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448730, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.124@KRBTEST.COM for oryx/127.20.244.124@KRBTEST.COM
I20260811 11:45:31.067529 29771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.060328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44973 (local address 127.0.0.1:49412)
0811 11:45:31.060442 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.060456 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.060529 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.060756 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.060759 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.060918 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:31.061014 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.061019 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.062093 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.062095 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.062587 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.062594 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.062998 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.063000 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.063056 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.063469 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:31.063479 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:31.064590 (+ 1111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:31.066167 (+ 1577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.066170 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.066171 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.066409 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.066649 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.066651 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.066652 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.066721 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.067031 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:31.067033 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:31.067168 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.067253 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.067396 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 11:45:31.067606 29770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.060388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49412 (local address 127.20.244.124:44973)
0811 11:45:31.060509 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.060512 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.060525 (+ 13us) server_negotiation.cc:407] Connection header received
0811 11:45:31.060600 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.060602 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.060636 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.060712 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.061116 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.061985 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.062690 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.062902 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.062983 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.064708 (+ 1725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.064711 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.064713 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.064733 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.066061 (+ 1328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.066499 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.066501 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.066502 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.066570 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.066796 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.066798 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.066799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.066952 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.067024 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.067314 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.067454 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":55}
I20260811 11:45:31.070392 29767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf: Bootstrap starting.
I20260811 11:45:31.072829 29767 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:31.073558 29767 log.cc:824] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:31.075515 29767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf: No bootstrap required, opened a new log
I20260811 11:45:31.078756 29767 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } }
I20260811 11:45:31.078982 29767 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:31.079066 29767 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0977a806ce7e43ccbc582c3022abedcf, State: Initialized, Role: FOLLOWER
I20260811 11:45:31.079519 29767 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } }
I20260811 11:45:31.079995 29774 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } } }
I20260811 11:45:31.080108 29774 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:45:31.080698 29767 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [sys.catalog]: configured and running, proceeding with master startup.
W20260811 11:45:31.085520 29789 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:45:31.085597 29789 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:45:31.088748 29571 master_runner.cc:428] Detected that this master 0977a806ce7e43ccbc582c3022abedcf is joining an existing cluster
I20260811 11:45:31.088825 29571 master_runner.cc:432] Initiating AddMaster RPC to add 127.20.244.124:44973
I20260811 11:45:31.102921 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 28949
I20260811 11:45:31.112236 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:45231
--local_ip_for_outbound_sockets=127.20.244.65
--tserver_master_addrs=127.20.244.126:33249
--webserver_port=41347
--webserver_interface=127.20.244.65
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.65.keytab
--principal=oryx/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:38121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.244.126:33249,127.20.244.125:37843
--tserver_master_addrs=127.20.244.126:33249,127.20.244.125:37843,127.20.244.124:44973 with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:45:31.117301 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.090858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56862 (local address 127.20.244.126:33249)
0811 11:45:31.090988 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.090993 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.091206 (+ 213us) server_negotiation.cc:407] Connection header received
0811 11:45:31.091395 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.091398 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.091465 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.091523 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.092375 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.093214 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.094518 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.094889 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.094968 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.096381 (+ 1413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.096387 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.096390 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.096417 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.098328 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.115633 (+ 17305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.115638 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.115640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.115758 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.116130 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.116134 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.116136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.116399 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.116483 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.116875 (+ 392us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.117095 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 11:45:31.118062 29797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.090793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.0.0.1:56862)
0811 11:45:31.091115 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.091132 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.091275 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.091811 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.091815 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.092085 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:31.092247 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.092254 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.093354 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.093357 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.094372 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.094383 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.095156 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.095160 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.095254 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.095720 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:31.095735 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:31.096235 (+ 500us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:31.098448 (+ 2213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.098452 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.098454 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.115462 (+ 17008us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.115905 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.115909 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.115911 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.116012 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.116546 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:31.116551 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:31.116659 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.117631 (+ 972us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.117821 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"mutex_wait_us":2,"thread_start_us":104,"threads_started":1}
I20260811 11:45:31.120002 29770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.091626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49424 (local address 127.20.244.124:44973)
0811 11:45:31.091725 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.091729 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.091745 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:45:31.091897 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.091900 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.091941 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.092023 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.092490 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.093217 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.096073 (+ 2856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.096318 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.096413 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.097632 (+ 1219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.097638 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.097644 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.097678 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.099261 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.118749 (+ 19488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.118752 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.118754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.118832 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.119170 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.119173 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.119175 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.119362 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.119428 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.119749 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.119860 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":11,"server-negotiator.queue_time_us":44}
I20260811 11:45:31.120651 29799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.091259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44973 (local address 127.0.0.1:49424)
0811 11:45:31.091683 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.091697 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.091782 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.092061 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.092066 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.092258 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:31.092378 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.092384 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.094388 (+ 2004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.094391 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.095938 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.095948 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.096411 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.096414 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.096522 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.097014 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:31.097029 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:31.097469 (+ 440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:31.099359 (+ 1890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.099363 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.099365 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.118658 (+ 19293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.118941 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.118944 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.118946 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.119035 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.119485 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:31.119488 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:31.119561 (+ 73us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.120359 (+ 798us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.120489 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"spinlock_wait_cycles":4992,"thread_start_us":83,"threads_started":1}
I20260811 11:45:31.123898 29772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.091678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52362 (local address 127.20.244.125:37843)
0811 11:45:31.091806 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.091810 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.091840 (+ 30us) server_negotiation.cc:407] Connection header received
0811 11:45:31.091897 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.091900 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.091942 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.092023 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.092953 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.093659 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.094580 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.094939 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.095010 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.116473 (+ 21463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.116477 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.116480 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.116511 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.118459 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.122403 (+ 3944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.122407 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.122408 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.122515 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.122853 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.122857 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.122858 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.123148 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.123232 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.123583 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.123723 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 11:45:31.124483 29795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.090812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:37843 (local address 127.0.0.1:52362)
0811 11:45:31.091204 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.091217 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.091303 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.092519 (+ 1216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.092522 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.092717 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:31.092816 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.092823 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.093771 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.093774 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.094450 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.094459 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.095212 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.095217 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.095305 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.115658 (+ 20353us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:31.115674 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:31.116242 (+ 568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:31.118610 (+ 2368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.118613 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.118615 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.122281 (+ 3666us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.122642 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.122645 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.122648 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.122744 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.123291 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:31.123295 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:31.123383 (+ 88us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.124100 (+ 717us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.124253 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"mutex_wait_us":57,"thread_start_us":101,"threads_started":1}
Aug 11 11:45:31 dist-test-slave-vkjp krb5kdc[28819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448729, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.126@KRBTEST.COM for oryx/127.20.244.124@KRBTEST.COM
I20260811 11:45:31.131592 29559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.122799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44973 (local address 127.0.0.1:49430)
0811 11:45:31.123391 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.123406 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.123485 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.123960 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.123963 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.124163 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:31.124272 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.124280 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.125613 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.125617 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.126159 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.126167 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.126616 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.126619 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.126716 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.127228 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:31.127242 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:31.128464 (+ 1222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:31.130096 (+ 1632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.130100 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.130102 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.130297 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.130609 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.130612 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.130614 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.130697 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.131052 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:31.131055 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:31.131176 (+ 121us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.131285 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.131436 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227}
I20260811 11:45:31.131590 29770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.123308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49430 (local address 127.20.244.124:44973)
0811 11:45:31.123623 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.123627 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.123638 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:45:31.123703 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.123706 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.123753 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.123823 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.124823 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.125501 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.126281 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.126495 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.126602 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.128593 (+ 1991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.128597 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.128599 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.128622 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.129968 (+ 1346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.130422 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.130426 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.130428 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.130513 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.130789 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.130793 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.130795 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.130953 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.131058 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.131348 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.131458 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251}
I20260811 11:45:31.132718 28874 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.20.244.124:44973: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf"
member_type: NON_VOTER
last_known_addr {
host: "127.20.244.124"
port: 44973
}
attrs {
promote: true
}
}
dest_uuid: "dc3a5b075c0b4be29c9047591ab3d38c"
cas_config_opid_index: 5
I20260811 11:45:31.133293 28874 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: NON_VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: true } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: NON_VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: true } }
I20260811 11:45:31.134431 29564 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 0977a806ce7e43ccbc582c3022abedcf (127.20.244.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: NON_VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: true } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: NON_VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: true } } }
I20260811 11:45:31.135069 29735 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:31.135970 29564 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.20.244.124:44973
I20260811 11:45:31.136140 29564 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: NON_VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: true } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: NON_VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: true } } }
I20260811 11:45:31.136271 29564 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:31.136564 29735 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 1 FOLLOWER]: Refusing update from remote peer dc3a5b075c0b4be29c9047591ab3d38c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 11:45:31.136832 29571 master.cc:537] Master@127.20.244.124:44973 shutting down...
I20260811 11:45:31.137655 29562 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: NON_VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 11:45:31.139504 28853 consensus_peers.cc:487] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c -> Peer 0977a806ce7e43ccbc582c3022abedcf (127.20.244.124:44973): Couldn't send request to peer 0977a806ce7e43ccbc582c3022abedcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 11:45:31.152415 29559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.134680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:37843 (local address 127.0.0.1:52376)
0811 11:45:31.135132 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.135148 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.135230 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.135653 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.135656 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.135672 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:31.135747 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.135752 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.136756 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.136759 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.150050 (+ 13291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.150066 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.151969 (+ 1903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.151973 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.152069 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.152119 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.152195 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.152272 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348}
I20260811 11:45:31.152784 29772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.134891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52376 (local address 127.20.244.125:37843)
0811 11:45:31.135010 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.135014 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.135317 (+ 303us) server_negotiation.cc:407] Connection header received
0811 11:45:31.135367 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.135373 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.135436 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.135533 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:31.135865 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.136621 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.150908 (+ 14287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.151633 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.151758 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.151892 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.152582 (+ 690us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.152667 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 11:45:31.156462 29639 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 1 LEARNER]: Refusing update from remote peer dc3a5b075c0b4be29c9047591ab3d38c: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 11:45:31.157123 29562 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: NON_VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 11:45:31.158226 29571 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:31.158502 29571 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:31.158607 29571 tablet_replica.cc:330] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf: stopping tablet replica
I20260811 11:45:31.159247 29639 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 0977a806ce7e43ccbc582c3022abedcf (127.20.244.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: NON_VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: true } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: NON_VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: true } } }
I20260811 11:45:31.161303 29682 sys_catalog.cc:455] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc3a5b075c0b4be29c9047591ab3d38c. Latest consensus state: current_term: 1 leader_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: NON_VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: true } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: NON_VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: true } } }
I20260811 11:45:31.161428 29682 sys_catalog.cc:458] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [sys.catalog]: This master's current role is: LEARNER
I20260811 11:45:31.161545 29682 sys_catalog.cc:455] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: NON_VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: true } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: NON_VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: true } } }
I20260811 11:45:31.161638 29682 sys_catalog.cc:458] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [sys.catalog]: This master's current role is: LEARNER
I20260811 11:45:31.162992 29562 raft_consensus.cc:1050] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c: attempting to promote NON_VOTER 069975cd170f4e85883ae295691c6046 to VOTER
I20260811 11:45:31.163461 29562 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: NON_VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: true } }
I20260811 11:45:31.164856 29559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.164433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44973 (local address 127.0.0.1:49432)
0811 11:45:31.164679 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.164776 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44973: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176}
I20260811 11:45:31.164839 29639 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 1 LEARNER]: Refusing update from remote peer dc3a5b075c0b4be29c9047591ab3d38c: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 11:45:31.165287 29566 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 11:45:31.165797 29559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.165374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44973 (local address 127.0.0.1:49440)
0811 11:45:31.165674 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.165723 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44973: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":84,"threads_started":1}
W20260811 11:45:31.166255 28853 consensus_peers.cc:487] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c -> Peer 0977a806ce7e43ccbc582c3022abedcf (127.20.244.124:44973): Couldn't send request to peer 0977a806ce7e43ccbc582c3022abedcf. Status: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 11:45:31.166860 29564 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 069975cd170f4e85883ae295691c6046 (127.20.244.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: NON_VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: true } } }
I20260811 11:45:31.168111 29564 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: NON_VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: true } } }
I20260811 11:45:31.168220 29564 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:31.168359 29564 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: NON_VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: true } } }
I20260811 11:45:31.168453 29564 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:31.168967 29639 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 069975cd170f4e85883ae295691c6046 (127.20.244.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: NON_VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: true } } }
I20260811 11:45:31.170152 29682 sys_catalog.cc:455] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: NON_VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: true } } }
I20260811 11:45:31.170269 29682 sys_catalog.cc:458] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:45:31.174484 29571 master.cc:552] Master@127.20.244.124:44973 shutdown complete.
I20260811 11:45:31.174566 29571 master_runner.cc:305] Clearing existing system tablet
I20260811 11:45:31.174849 29571 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:31.174938 29571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:31.176530 29571 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:31.177634 29806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:31.177891 29571 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:31.178072 29571 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:31.178123 29571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/wal
uuid: "0977a806ce7e43ccbc582c3022abedcf"
format_stamp: "Formatted at 2026-08-11 11:45:30 on dist-test-slave-vkjp"
server_key: "a457980c52fba3af09583d1f3d397e66"
server_key_iv: "8a19a6f4c4b4cdb3af1bf94474e30c66"
server_key_version: "encryptionkey@0"
I20260811 11:45:31.180110 29571 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:31.182718 29571 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 11:45:31.182837 29571 log.cc:1196] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 11:45:31.183184 29571 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf: Deleting consensus metadata
I20260811 11:45:31.183425 29571 master_runner.cc:315] Copying system tablet from 127.20.244.126:33249
I20260811 11:45:31.184759 29571 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf: tablet copy: Beginning tablet copy session from remote peer at address 127.20.244.126:33249
I20260811 11:45:31.193554 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.185423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56876 (local address 127.20.244.126:33249)
0811 11:45:31.185597 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.185602 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.185859 (+ 257us) server_negotiation.cc:407] Connection header received
0811 11:45:31.186009 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.186013 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.186061 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.186167 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.186654 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.187331 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.188236 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.188568 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.188684 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.190097 (+ 1413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.190101 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.190104 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.190134 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.191781 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.192249 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.192254 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.192256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.192352 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.192660 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.192665 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.192667 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.192858 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.192974 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.193259 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.193386 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 11:45:31.193567 29813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.185368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.0.0.1:56876)
0811 11:45:31.185750 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.185771 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.185911 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.186199 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.186202 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.186419 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:31.186527 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.186533 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.187448 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.187453 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.188106 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.188114 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.188690 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.188694 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.188821 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.189422 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:31.189444 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:31.189904 (+ 460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:31.191903 (+ 1999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.191909 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.191912 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.192131 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.192462 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.192466 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.192468 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.192560 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.192965 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:31.192969 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:31.193079 (+ 110us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.193199 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.193349 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":105,"threads_started":1}
I20260811 11:45:31.194432 28898 tablet_copy_service.cc:140] P dc3a5b075c0b4be29c9047591ab3d38c: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 0977a806ce7e43ccbc582c3022abedcf ({username='oryx', principal='oryx/127.20.244.124@KRBTEST.COM'} at 127.0.0.1:56876)
I20260811 11:45:31.194540 28898 tablet_copy_service.cc:161] P dc3a5b075c0b4be29c9047591ab3d38c: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 0977a806ce7e43ccbc582c3022abedcf at {username='oryx', principal='oryx/127.20.244.124@KRBTEST.COM'} at 127.0.0.1:56876: session id = 0977a806ce7e43ccbc582c3022abedcf-00000000000000000000000000000000
I20260811 11:45:31.195655 28898 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 11:45:31.196820 29571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 11:45:31.198719 29571 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf: tablet copy: Starting download of 0 data blocks...
I20260811 11:45:31.198949 29571 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf: tablet copy: Starting download of 1 WAL segments...
I20260811 11:45:31.200532 29571 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 11:45:31.202214 28898 tablet_copy_service.cc:342] P dc3a5b075c0b4be29c9047591ab3d38c: Request end of tablet copy session 0977a806ce7e43ccbc582c3022abedcf-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.20.244.124@KRBTEST.COM'} at 127.0.0.1:56876
I20260811 11:45:31.202319 28898 tablet_copy_service.cc:433] P dc3a5b075c0b4be29c9047591ab3d38c: ending tablet copy session 0977a806ce7e43ccbc582c3022abedcf-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 0977a806ce7e43ccbc582c3022abedcf
I20260811 11:45:31.209539 29571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:31.211849 29815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:31.211921 29818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:31.211966 29816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:31.212702 29571 server_base.cc:1034] running on GCE node
I20260811 11:45:31.212894 29571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:31.213236 29571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:31.214398 29571 hybrid_clock.cc:648] HybridClock initialized: now 1786448731214389 us; error 27 us; skew 500 ppm
Aug 11 11:45:31 dist-test-slave-vkjp krb5kdc[28819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448731, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:31.216081 29571 init.cc:377] Logged in from keytab as oryx/127.20.244.124@KRBTEST.COM (short username oryx)
I20260811 11:45:31.216691 29571 webserver.cc:460] Webserver started at http://127.20.244.124:45785/ using document root <none> and password file <none>
I20260811 11:45:31.216928 29571 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:31.216990 29571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:31.218498 29571 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 11:45:31.219574 29827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:31.219830 29571 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:45:31.219934 29571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/wal
uuid: "0977a806ce7e43ccbc582c3022abedcf"
format_stamp: "Formatted at 2026-08-11 11:45:30 on dist-test-slave-vkjp"
server_key: "a457980c52fba3af09583d1f3d397e66"
server_key_iv: "8a19a6f4c4b4cdb3af1bf94474e30c66"
server_key_version: "encryptionkey@0"
I20260811 11:45:31.220047 29571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:31.231758 29571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:31.234009 29571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:31.239976 29571 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.124:44973
I20260811 11:45:31.239996 29898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.124:44973 every 8 connection(s)
I20260811 11:45:31.240584 29571 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/master-2/data/info.pb
I20260811 11:45:31.242681 29899 sys_catalog.cc:263] Verifying existing consensus state
I20260811 11:45:31.243939 29899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf: Bootstrap starting.
I20260811 11:45:31.254364 29899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:45:31.254699 29899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf: Bootstrap complete.
I20260811 11:45:31.255291 29899 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: NON_VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: true } }
I20260811 11:45:31.255455 29899 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0977a806ce7e43ccbc582c3022abedcf, State: Initialized, Role: LEARNER
I20260811 11:45:31.255604 29899 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: NON_VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: true } }
I20260811 11:45:31.255982 29904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: NON_VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: true } } }
I20260811 11:45:31.256167 29899 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:45:31.256174 29904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [sys.catalog]: This master's current role is: LEARNER
I20260811 11:45:31.259945 29919 catalog_manager.cc:1259] Loaded cluster ID: 099b90cae7d948e6920e7219d648152b
I20260811 11:45:31.260080 29919 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf: loading cluster ID for follower catalog manager: success
I20260811 11:45:31.261921 29919 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf: acquiring CA information for follower catalog manager: success
I20260811 11:45:31.263216 29919 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 11:45:31.264560 29276 heartbeater.cc:503] Master 127.20.244.126:33249 was elected leader, sending a full tablet report...
W20260811 11:45:31.272840 29801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:31.273205 29801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:31.273268 29801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:31.279366 29801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:31.279436 29801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:31.279525 29801 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:45:31.287567 29801 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:38121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.65.keytab
--principal=oryx/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:45231
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=41347
--tserver_master_addrs=127.20.244.126:33249,127.20.244.125:37843,127.20.244.124:44973
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29801
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:31.288774 29801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:31.290056 29801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:45:31.301635 29801 server_base.cc:1034] running on GCE node
W20260811 11:45:31.301600 29924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:31.301577 29925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:31.301558 29928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:31.302244 29801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:31.302973 29801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:31.304154 29801 hybrid_clock.cc:648] HybridClock initialized: now 1786448731304131 us; error 33 us; skew 500 ppm
Aug 11 11:45:31 dist-test-slave-vkjp krb5kdc[28819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448731, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:31.307307 29801 init.cc:377] Logged in from keytab as oryx/127.20.244.65@KRBTEST.COM (short username oryx)
I20260811 11:45:31.308218 29801 webserver.cc:460] Webserver started at http://127.20.244.65:41347/ using document root <none> and password file <none>
I20260811 11:45:31.308828 29801 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:31.308954 29801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:31.313055 29801 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 11:45:31.315238 29937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:31.316622 29801 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:45:31.316761 29801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "09025679fb854a8dadd0ff0e1952e5f9"
format_stamp: "Formatted at 2026-08-11 11:45:29 on dist-test-slave-vkjp"
server_key: "d61a65670126aff7fab27caf9e422aa6"
server_key_iv: "366dc0619780c2ba7a2bdb8652065d2b"
server_key_version: "encryptionkey@0"
I20260811 11:45:31.317584 29801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:31.332254 29801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:31.335825 29801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:31.336040 29801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:31.336671 29801 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:31.337697 29801 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:31.337771 29801 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:31.337858 29801 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:31.337900 29801 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:31.348131 29801 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:45231
I20260811 11:45:31.348196 30075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:45231 every 8 connection(s)
I20260811 11:45:31.349253 29801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:45:31.354122 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 29801
I20260811 11:45:31.354367 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 29116
Aug 11 11:45:31 dist-test-slave-vkjp krb5kdc[28819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448731, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.125@KRBTEST.COM
Aug 11 11:45:31 dist-test-slave-vkjp krb5kdc[28819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448731, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM
I20260811 11:45:31.370288 29772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.352780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:38875 (local address 127.20.244.125:37843)
0811 11:45:31.352912 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.352915 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.352976 (+ 61us) server_negotiation.cc:407] Connection header received
0811 11:45:31.353595 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.353599 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.353663 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.353727 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.355451 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.356322 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.359108 (+ 2786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.359387 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.359497 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.364919 (+ 5422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.364928 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.364936 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.364982 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.367232 (+ 2250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.368001 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.368007 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.368012 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.368108 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.368591 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.368598 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.368603 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.368893 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.368983 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.369857 (+ 874us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.370017 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 11:45:31.372439 30086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.352637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:37843 (local address 127.20.244.65:38875)
0811 11:45:31.352895 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.352910 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.353347 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.353934 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.353940 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.354526 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:31.355282 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.355302 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.356508 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.356515 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.358942 (+ 2427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.358960 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.359589 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.359599 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.359946 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.362402 (+ 2456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:31.362437 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:31.364719 (+ 2282us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:31.367391 (+ 2672us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.367401 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.367421 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.367885 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.368235 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.368242 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.368248 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.368465 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.369082 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:31.369092 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:31.369441 (+ 349us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.370713 (+ 1272us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.371199 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"mutex_wait_us":3,"spinlock_wait_cycles":2304,"thread_start_us":80,"threads_started":1}
Aug 11 11:45:31 dist-test-slave-vkjp krb5kdc[28819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448731, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.124@KRBTEST.COM
I20260811 11:45:31.374336 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.351177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:34963 (local address 127.20.244.126:33249)
0811 11:45:31.351334 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.351339 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.352274 (+ 935us) server_negotiation.cc:407] Connection header received
0811 11:45:31.353573 (+ 1299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.353576 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.353641 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.353744 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.359878 (+ 6134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.360451 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.362269 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.362505 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.362627 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.369923 (+ 7296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.369927 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.369930 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.369958 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.371717 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.372218 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.372222 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.372224 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.372313 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.373310 (+ 997us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.373316 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.373319 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.373567 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.373669 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.374035 (+ 366us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.374165 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 11:45:31.375043 30080 heartbeater.cc:347] Connected to a master server at 127.20.244.125:37843
I20260811 11:45:31.375355 30080 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:31.375967 30080 heartbeater.cc:511] Master 127.20.244.125:37843 requested a full tablet report, sending...
I20260811 11:45:31.376708 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:44491
--local_ip_for_outbound_sockets=127.20.244.66
--tserver_master_addrs=127.20.244.126:33249
--webserver_port=42551
--webserver_interface=127.20.244.66
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.66.keytab
--principal=oryx/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:38121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.244.126:33249,127.20.244.125:37843
--tserver_master_addrs=127.20.244.126:33249,127.20.244.125:37843,127.20.244.124:44973 with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:45:31.377074 30084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.351618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.65:34963)
0811 11:45:31.352115 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.352167 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.353352 (+ 1185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.353930 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.353937 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.359621 (+ 5684us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:31.359742 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.359748 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.360619 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.360627 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.362121 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.362138 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.362630 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.362633 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.362730 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.368246 (+ 5516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:31.368273 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:31.369764 (+ 1491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:31.371841 (+ 2077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.371844 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.371846 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.372102 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.372723 (+ 621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.372729 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.372733 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.372832 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.373736 (+ 904us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:31.373739 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:31.373828 (+ 89us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.376705 (+ 2877us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.376846 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"mutex_wait_us":22,"spinlock_wait_cycles":45056,"thread_start_us":184,"threads_started":1}
I20260811 11:45:31.377760 29627 ts_manager.cc:194] Registered new tserver with Master: 09025679fb854a8dadd0ff0e1952e5f9 (127.20.244.65:45231)
I20260811 11:45:31.378535 30083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.351618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44973 (local address 127.20.244.65:57557)
0811 11:45:31.352115 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.352168 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.353347 (+ 1179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.367595 (+ 14248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.367601 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.367892 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:31.368076 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.368089 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.370196 (+ 2107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.370202 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.371360 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.371372 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.372202 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.372206 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.372301 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.372775 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:31.372791 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:31.374212 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:31.376474 (+ 2262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.376478 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.376480 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.376769 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.377482 (+ 713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.377485 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.377487 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.377597 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.378037 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:31.378039 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:31.378109 (+ 70us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.378213 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.378347 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":28,"spinlock_wait_cycles":6784,"thread_start_us":109,"threads_started":1}
I20260811 11:45:31.378564 30082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.351160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:57557 (local address 127.20.244.124:44973)
0811 11:45:31.351478 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.351491 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.352276 (+ 785us) server_negotiation.cc:407] Connection header received
0811 11:45:31.353610 (+ 1334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.353614 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.353670 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.353735 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.368946 (+ 15211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.370042 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.371516 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.371920 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.372010 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.374373 (+ 2363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.374380 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.374387 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.374424 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.376343 (+ 1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.377115 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.377119 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.377120 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.377240 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.377687 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.377690 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.377692 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.377873 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.377987 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.378285 (+ 298us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.378406 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":105,"threads_started":1}
I20260811 11:45:31.378847 30079 heartbeater.cc:347] Connected to a master server at 127.20.244.126:33249
I20260811 11:45:31.378939 30079 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:31.379154 30079 heartbeater.cc:511] Master 127.20.244.126:33249 requested a full tablet report, sending...
I20260811 11:45:31.379994 28874 ts_manager.cc:194] Re-registered known tserver with Master: 09025679fb854a8dadd0ff0e1952e5f9 (127.20.244.65:45231)
I20260811 11:45:31.380326 30076 heartbeater.cc:347] Connected to a master server at 127.20.244.124:44973
I20260811 11:45:31.380414 30076 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:31.380570 30076 heartbeater.cc:511] Master 127.20.244.124:44973 requested a full tablet report, sending...
I20260811 11:45:31.380718 28874 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:34963
I20260811 11:45:31.381590 29847 ts_manager.cc:194] Registered new tserver with Master: 09025679fb854a8dadd0ff0e1952e5f9 (127.20.244.65:45231)
I20260811 11:45:31.492223 29444 heartbeater.cc:503] Master 127.20.244.126:33249 was elected leader, sending a full tablet report...
W20260811 11:45:31.498363 30088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:31.498598 30088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:31.498641 30088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:31.502720 30088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:31.502776 30088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:31.502835 30088 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:45:31.508338 30088 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:38121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.66.keytab
--principal=oryx/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:44491
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=42551
--tserver_master_addrs=127.20.244.126:33249,127.20.244.125:37843,127.20.244.124:44973
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30088
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:31.509418 30088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:31.510488 30088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:31.520744 30095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:31.520705 30094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:31.520774 30097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:31.520889 30088 server_base.cc:1034] running on GCE node
I20260811 11:45:31.521574 30088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:31.522248 30088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:31.523430 30088 hybrid_clock.cc:648] HybridClock initialized: now 1786448731523384 us; error 61 us; skew 500 ppm
Aug 11 11:45:31 dist-test-slave-vkjp krb5kdc[28819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448731, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:31.526180 30088 init.cc:377] Logged in from keytab as oryx/127.20.244.66@KRBTEST.COM (short username oryx)
I20260811 11:45:31.526993 30088 webserver.cc:460] Webserver started at http://127.20.244.66:42551/ using document root <none> and password file <none>
I20260811 11:45:31.527582 30088 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:31.527659 30088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:31.531455 30088 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 11:45:31.533425 30104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:31.534718 30088 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:31.534813 30088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "f902f72b2c094219b426f4a0cd80529b"
format_stamp: "Formatted at 2026-08-11 11:45:30 on dist-test-slave-vkjp"
server_key: "ad49ba2e105952a704aaa1a4e1e7233b"
server_key_iv: "39383628b5b98c60b3e65bba08e890eb"
server_key_version: "encryptionkey@0"
I20260811 11:45:31.535421 30088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:31.549577 30088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:31.552696 30088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:31.552920 30088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:31.553449 30088 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:31.554301 30088 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:31.554347 30088 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:31.554388 30088 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:31.554412 30088 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:31.564076 30088 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:44491
I20260811 11:45:31.564097 30247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:44491 every 8 connection(s)
I20260811 11:45:31.565064 30088 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:45:31.566483 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 30088
I20260811 11:45:31.566666 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 29282
I20260811 11:45:31.583817 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:32783
--local_ip_for_outbound_sockets=127.20.244.67
--tserver_master_addrs=127.20.244.126:33249
--webserver_port=38717
--webserver_interface=127.20.244.67
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.67.keytab
--principal=oryx/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:38121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.244.126:33249,127.20.244.125:37843
--tserver_master_addrs=127.20.244.126:33249,127.20.244.125:37843,127.20.244.124:44973 with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 11:45:31 dist-test-slave-vkjp krb5kdc[28819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448731, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM
Aug 11 11:45:31 dist-test-slave-vkjp krb5kdc[28819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448731, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.125@KRBTEST.COM
Aug 11 11:45:31 dist-test-slave-vkjp krb5kdc[28819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448731, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.124@KRBTEST.COM
I20260811 11:45:31.592739 30082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.567300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:34499 (local address 127.20.244.124:44973)
0811 11:45:31.567487 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.567494 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.577224 (+ 9730us) server_negotiation.cc:407] Connection header received
0811 11:45:31.578691 (+ 1467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.578695 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.578751 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.578807 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.580972 (+ 2165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.581807 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.585691 (+ 3884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.586104 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.586215 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.588610 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.588615 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.588619 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.588651 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.590623 (+ 1972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.591128 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.591132 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.591133 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.591229 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.591542 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.591546 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.591548 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.591770 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.591848 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.592430 (+ 582us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.592563 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 11:45:31.592739 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.568299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:51639 (local address 127.20.244.126:33249)
0811 11:45:31.575756 (+ 7457us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.575763 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.577218 (+ 1455us) server_negotiation.cc:407] Connection header received
0811 11:45:31.578696 (+ 1478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.578703 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.578768 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.578839 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.580972 (+ 2133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.581877 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.583678 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.583942 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.584059 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.588165 (+ 4106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.588169 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.588172 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.588204 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.590117 (+ 1913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.590752 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.590756 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.590758 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.590843 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.591319 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.591324 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.591327 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.591579 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.591662 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.592430 (+ 768us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.592563 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7331}
I20260811 11:45:31.594532 30257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.567689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44973 (local address 127.20.244.66:34499)
0811 11:45:31.577063 (+ 9374us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.577109 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.578444 (+ 1335us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.579249 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.579259 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.579931 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:31.580792 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.580813 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.582000 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.582004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.583975 (+ 1971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.583990 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.586377 (+ 2387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.586385 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.586497 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.586990 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:31.587005 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:31.588442 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:31.590750 (+ 2308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.590752 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.590754 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.590991 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.591342 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.591345 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.591346 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.591433 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.591902 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:31.591905 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:31.592106 (+ 201us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.592971 (+ 865us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.593417 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9297,"mutex_wait_us":1213,"spinlock_wait_cycles":10880,"thread_start_us":473,"threads_started":1}
I20260811 11:45:31.594813 30255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.567312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.66:51639)
0811 11:45:31.577051 (+ 9739us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.577112 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.578438 (+ 1326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.579251 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.579261 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.579933 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:31.580807 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.580821 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.582032 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.582037 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.583557 (+ 1520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.583566 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.584233 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.584236 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.584462 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.585149 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:31.585176 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:31.587949 (+ 2773us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:31.590257 (+ 2308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.590264 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.590281 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.590629 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.590976 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.590978 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.590980 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.591200 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.591750 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:31.591756 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:31.592106 (+ 350us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.592971 (+ 865us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.593467 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9478,"mutex_wait_us":339,"spinlock_wait_cycles":77952,"thread_start_us":768,"threads_started":1}
I20260811 11:45:31.596036 30248 heartbeater.cc:347] Connected to a master server at 127.20.244.124:44973
I20260811 11:45:31.596076 30250 heartbeater.cc:347] Connected to a master server at 127.20.244.126:33249
I20260811 11:45:31.596311 30250 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:31.596309 30248 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:31.596979 30250 heartbeater.cc:511] Master 127.20.244.126:33249 requested a full tablet report, sending...
I20260811 11:45:31.596985 30248 heartbeater.cc:511] Master 127.20.244.124:44973 requested a full tablet report, sending...
I20260811 11:45:31.598132 28874 ts_manager.cc:194] Re-registered known tserver with Master: f902f72b2c094219b426f4a0cd80529b (127.20.244.66:44491)
I20260811 11:45:31.599016 29847 ts_manager.cc:194] Registered new tserver with Master: f902f72b2c094219b426f4a0cd80529b (127.20.244.66:44491)
I20260811 11:45:31.599064 28874 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:51639
I20260811 11:45:31.603053 29772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.569485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:49943 (local address 127.20.244.125:37843)
0811 11:45:31.575920 (+ 6435us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.575924 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.577763 (+ 1839us) server_negotiation.cc:407] Connection header received
0811 11:45:31.578691 (+ 928us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.578695 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.578751 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.578807 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.580970 (+ 2163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.581807 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.584456 (+ 2649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.584823 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.584948 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.596501 (+ 11553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.596506 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.596509 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.596544 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.600509 (+ 3965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.601855 (+ 1346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.601858 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.601860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.601950 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.602256 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.602260 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.602261 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.602475 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.602556 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.602840 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.602943 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6311}
I20260811 11:45:31.603134 30256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.568952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:37843 (local address 127.20.244.66:49943)
0811 11:45:31.577670 (+ 8718us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.577682 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.578444 (+ 762us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.579249 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.579259 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.579934 (+ 675us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:31.580792 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.580813 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.582000 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.582004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.584247 (+ 2243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.584259 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.584952 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.584955 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.585046 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.585539 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:31.585559 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:31.596243 (+ 10684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:31.601468 (+ 5225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.601473 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.601477 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.601730 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.602057 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.602060 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.602062 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.602140 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.602576 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:31.602579 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:31.602672 (+ 93us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.602768 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.602923 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8666,"mutex_wait_us":194,"spinlock_wait_cycles":25984,"thread_start_us":197,"threads_started":1}
I20260811 11:45:31.603709 30253 heartbeater.cc:347] Connected to a master server at 127.20.244.125:37843
I20260811 11:45:31.603816 30253 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:31.604007 30253 heartbeater.cc:511] Master 127.20.244.125:37843 requested a full tablet report, sending...
I20260811 11:45:31.604725 29627 ts_manager.cc:194] Registered new tserver with Master: f902f72b2c094219b426f4a0cd80529b (127.20.244.66:44491)
I20260811 11:45:31.690598 30082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.686756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49442 (local address 127.20.244.124:44973)
0811 11:45:31.686969 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.686974 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.686993 (+ 19us) server_negotiation.cc:407] Connection header received
0811 11:45:31.687104 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.687108 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.687176 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.687292 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:31.687571 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.688373 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.689428 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.690075 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.690207 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.690361 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.690399 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.690465 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260811 11:45:31.690632 30260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.686585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44973 (local address 127.0.0.1:49442)
0811 11:45:31.686853 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.686873 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.686991 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.687314 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.687317 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.687339 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:31.687447 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.687453 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.688496 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.688498 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.689299 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.689309 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.690206 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.690208 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.690285 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.690307 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.690373 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.690440 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":75,"threads_started":1}
I20260811 11:45:31.691347 29860 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260811 11:45:31.691798 29904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc3a5b075c0b4be29c9047591ab3d38c. Latest consensus state: current_term: 1 leader_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: NON_VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: true } } }
I20260811 11:45:31.691990 29904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [sys.catalog]: This master's current role is: LEARNER
W20260811 11:45:31.706557 30258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:31.706794 30258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:31.706879 30258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:31.710873 30258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:31.710939 30258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:31.711014 30258 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:45:31.716202 30258 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:38121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.67.keytab
--principal=oryx/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:32783
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=38717
--tserver_master_addrs=127.20.244.126:33249,127.20.244.125:37843,127.20.244.124:44973
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30258
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:31.717216 30258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:31.718214 30258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:31.728003 30267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:31.728014 30268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:31.728003 30270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:31.728310 30258 server_base.cc:1034] running on GCE node
I20260811 11:45:31.728938 30258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:31.729622 30258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:31.730811 30258 hybrid_clock.cc:648] HybridClock initialized: now 1786448731730780 us; error 41 us; skew 500 ppm
Aug 11 11:45:31 dist-test-slave-vkjp krb5kdc[28819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448731, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:31.733531 30258 init.cc:377] Logged in from keytab as oryx/127.20.244.67@KRBTEST.COM (short username oryx)
I20260811 11:45:31.734375 30258 webserver.cc:460] Webserver started at http://127.20.244.67:38717/ using document root <none> and password file <none>
I20260811 11:45:31.734934 30258 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:31.735047 30258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:31.739429 30258 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 11:45:31.741468 30278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:31.742638 30258 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:31.742774 30258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "c261356616aa44aca005f79e87745598"
format_stamp: "Formatted at 2026-08-11 11:45:30 on dist-test-slave-vkjp"
server_key: "e7ec08c76cde34e99235ced7f4ba3873"
server_key_iv: "d3b24acb3a553f8f1ad3195da3d09ccc"
server_key_version: "encryptionkey@0"
I20260811 11:45:31.743438 30258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:31.762879 30258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:31.765770 30258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:31.765915 30258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:31.766420 30258 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:31.767272 30258 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:31.767325 30258 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:31.767367 30258 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:31.767401 30258 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:31.776634 30258 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:32783
I20260811 11:45:31.776669 30420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:32783 every 8 connection(s)
I20260811 11:45:31.777738 30258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:45:31.782039 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 30258
Aug 11 11:45:31 dist-test-slave-vkjp krb5kdc[28819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448731, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM
Aug 11 11:45:31 dist-test-slave-vkjp krb5kdc[28819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448731, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.125@KRBTEST.COM
Aug 11 11:45:31 dist-test-slave-vkjp krb5kdc[28819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448731, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.124@KRBTEST.COM
I20260811 11:45:31.797344 30427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.780167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44973 (local address 127.20.244.67:53375)
0811 11:45:31.780749 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.780811 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.782003 (+ 1192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.782795 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.782828 (+ 33us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.783597 (+ 769us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:31.784424 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.784448 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.785644 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.785647 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.787148 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.787159 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.787858 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.787862 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.788153 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.789536 (+ 1383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:31.789554 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:31.791712 (+ 2158us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:31.793658 (+ 1946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.793666 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.793684 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.794046 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.794381 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.794386 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.794390 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.794577 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.795225 (+ 648us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:31.795234 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:31.795572 (+ 338us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.795807 (+ 235us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.796164 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"mutex_wait_us":223,"spinlock_wait_cycles":45568,"thread_start_us":157,"threads_started":1}
I20260811 11:45:31.798130 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.779578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:50467 (local address 127.20.244.126:33249)
0811 11:45:31.779710 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.779715 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.780920 (+ 1205us) server_negotiation.cc:407] Connection header received
0811 11:45:31.782269 (+ 1349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.782273 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.782330 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.782387 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.785013 (+ 2626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.785813 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.787250 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.787600 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.787692 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.791872 (+ 4180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.791876 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.791879 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.791903 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.794685 (+ 2782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.796743 (+ 2058us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.796747 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.796749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.796843 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.797166 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.797169 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.797171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.797372 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.797463 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.797817 (+ 354us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.797943 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 11:45:31.798182 30082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.779578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:53375 (local address 127.20.244.124:44973)
0811 11:45:31.779710 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.779715 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.780920 (+ 1205us) server_negotiation.cc:407] Connection header received
0811 11:45:31.782292 (+ 1372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.782296 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.782347 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.782401 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.784612 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.785457 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.787303 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.787631 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.787720 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.791877 (+ 4157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.791880 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.791883 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.791908 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.793528 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.794170 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.794174 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.794176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.794263 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.794691 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.794696 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.794698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.795035 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.795163 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.797890 (+ 2727us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.798015 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":52}
I20260811 11:45:31.798693 30426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.780167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.67:50467)
0811 11:45:31.780749 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.780811 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.781989 (+ 1178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.782795 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.782804 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.783604 (+ 800us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:31.784811 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.784819 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.785977 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.785982 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.787148 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.787159 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.787857 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.787862 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.788109 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.788754 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:31.788776 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:31.791682 (+ 2906us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:31.796342 (+ 4660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.796345 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.796347 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.796626 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.796962 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.796968 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.796971 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.797059 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.797525 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:31.797528 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:31.797615 (+ 87us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.798336 (+ 721us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.798492 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"mutex_wait_us":901,"spinlock_wait_cycles":31360,"thread_start_us":141,"threads_started":1}
I20260811 11:45:31.799301 30422 heartbeater.cc:347] Connected to a master server at 127.20.244.124:44973
I20260811 11:45:31.799562 30422 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:31.799873 30437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.784587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56888 (local address 127.20.244.126:33249)
0811 11:45:31.787153 (+ 2566us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.787158 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.787171 (+ 13us) server_negotiation.cc:407] Connection header received
0811 11:45:31.787205 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.787230 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.788463 (+ 1233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.788559 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.789645 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.790534 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.792194 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.792589 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.792692 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.794936 (+ 2244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.794939 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.794942 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.794968 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.796756 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.797290 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.797294 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.797295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.797393 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.798047 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.798050 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.798052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.798674 (+ 622us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.799553 (+ 879us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.799642 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.799763 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2473,"thread_start_us":62,"threads_started":1}
I20260811 11:45:31.800179 30422 heartbeater.cc:511] Master 127.20.244.124:44973 requested a full tablet report, sending...
I20260811 11:45:31.800800 30423 heartbeater.cc:347] Connected to a master server at 127.20.244.126:33249
I20260811 11:45:31.800884 30423 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:31.801007 29772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.781392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:45581 (local address 127.20.244.125:37843)
0811 11:45:31.781518 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.781522 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.781702 (+ 180us) server_negotiation.cc:407] Connection header received
0811 11:45:31.782247 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.782251 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.782312 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.782370 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.785160 (+ 2790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.785912 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.787422 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.787747 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.787836 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.792193 (+ 4357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.792197 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.792200 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.792227 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.795450 (+ 3223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.799688 (+ 4238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.799691 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.799693 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.799777 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.800089 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.800092 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.800094 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.800295 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.800377 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.800710 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.800834 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":55}
I20260811 11:45:31.801079 30423 heartbeater.cc:511] Master 127.20.244.126:33249 requested a full tablet report, sending...
I20260811 11:45:31.801524 30428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.781263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:37843 (local address 127.20.244.67:45581)
0811 11:45:31.781608 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.781620 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.781990 (+ 370us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.782799 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.782805 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.783602 (+ 797us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:31.785020 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.785031 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.786024 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.786031 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.787306 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.787312 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.788000 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.788004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.788125 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.788995 (+ 870us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:31.789015 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:31.792048 (+ 3033us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:31.799171 (+ 7123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.799177 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.799180 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.799574 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.799887 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:31.799890 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:31.799891 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:31.799978 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:31.800445 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:31.800448 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:31.800527 (+ 79us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.801181 (+ 654us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.801325 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"mutex_wait_us":994,"spinlock_wait_cycles":28416,"thread_start_us":85,"threads_started":1}
I20260811 11:45:31.802073 30424 heartbeater.cc:347] Connected to a master server at 127.20.244.125:37843
I20260811 11:45:31.802155 30424 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:31.802145 29847 ts_manager.cc:194] Registered new tserver with Master: c261356616aa44aca005f79e87745598 (127.20.244.67:32783)
I20260811 11:45:31.802309 30424 heartbeater.cc:511] Master 127.20.244.125:37843 requested a full tablet report, sending...
I20260811 11:45:31.802448 30436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.784431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52384 (local address 127.20.244.125:37843)
0811 11:45:31.785079 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.785092 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.785656 (+ 564us) server_negotiation.cc:407] Connection header received
0811 11:45:31.785694 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.785696 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.785737 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.785807 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.786962 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.787729 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.789776 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.790127 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.790223 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.791901 (+ 1678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.791905 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.791908 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.791944 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.796220 (+ 4276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.797877 (+ 1657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.797880 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.797882 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.797983 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.798641 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.798644 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.798646 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.798913 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.802087 (+ 3174us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.802176 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.802303 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":579,"thread_start_us":87,"threads_started":1}
I20260811 11:45:31.802961 29627 ts_manager.cc:194] Registered new tserver with Master: c261356616aa44aca005f79e87745598 (127.20.244.67:32783)
I20260811 11:45:31.803406 28873 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56888:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:45:31.806672 28873 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:45:31.807329 30439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.784806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49454 (local address 127.20.244.124:44973)
0811 11:45:31.789160 (+ 4354us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.789164 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.793548 (+ 4384us) server_negotiation.cc:407] Connection header received
0811 11:45:31.793738 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.793743 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.793794 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.793864 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.794818 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.795755 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.797115 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.797454 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.797527 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.804125 (+ 6598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.804129 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.804132 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.804155 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.805497 (+ 1342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.805971 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.805975 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.805976 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.806061 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.806352 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.806356 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.806358 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.806537 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.806674 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.806940 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.807064 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":4274,"thread_start_us":87,"threads_started":1}
I20260811 11:45:31.807366 28874 ts_manager.cc:194] Re-registered known tserver with Master: c261356616aa44aca005f79e87745598 (127.20.244.67:32783)
I20260811 11:45:31.807902 28874 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:50467
I20260811 11:45:31.809916 30259 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: NON_VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: true } } }
I20260811 11:45:31.810042 30259 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:31.813128 30259 raft_consensus.cc:1050] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c: attempting to promote NON_VOTER 0977a806ce7e43ccbc582c3022abedcf to VOTER
I20260811 11:45:31.813521 30259 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: false } }
I20260811 11:45:31.814579 29860 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 1 LEARNER]: Refusing update from remote peer dc3a5b075c0b4be29c9047591ab3d38c: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 11:45:31.814761 29639 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 1 FOLLOWER]: Refusing update from remote peer dc3a5b075c0b4be29c9047591ab3d38c: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 11:45:31.815155 30259 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 11:45:31.815318 30442 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 11:45:31.816879 30441 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 0977a806ce7e43ccbc582c3022abedcf (127.20.244.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: false } } }
I20260811 11:45:31.818274 30259 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: false } } }
I20260811 11:45:31.818419 30259 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:31.818300 30441 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: false } } }
I20260811 11:45:31.818652 30441 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:31.818867 30442 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: false } } }
I20260811 11:45:31.818980 30442 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:31.818959 29639 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 0977a806ce7e43ccbc582c3022abedcf (127.20.244.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: false } } }
I20260811 11:45:31.819150 29860 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 0977a806ce7e43ccbc582c3022abedcf (127.20.244.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: false } } }
I20260811 11:45:31.820302 30450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: false } } }
I20260811 11:45:31.820446 30450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:45:31.820675 29904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: false } } }
I20260811 11:45:31.820781 29904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:45:31.829433 30260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.824375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:45231 (local address 127.0.0.1:36654)
0811 11:45:31.824512 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.824529 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.824603 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.825409 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.825412 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.825444 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:31.825547 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.825554 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.827186 (+ 1632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.827189 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.828213 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.828222 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.829055 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.829059 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.829140 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.829162 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.829224 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.829310 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 11:45:31.829494 30452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.824538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36654 (local address 127.20.244.65:45231)
0811 11:45:31.824874 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.824889 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.824910 (+ 21us) server_negotiation.cc:407] Connection header received
0811 11:45:31.825002 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.825007 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.825237 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.825719 (+ 482us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:31.825854 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.827019 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.828365 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.828927 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.829055 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.829211 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.829266 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.829357 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":61,"threads_started":1}
I20260811 11:45:31.830518 30453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.824642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:44491 (local address 127.0.0.1:50250)
0811 11:45:31.824901 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.824917 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.825007 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.825988 (+ 981us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.825991 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.826010 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:31.826116 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.826121 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.827468 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.827472 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.828604 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.828614 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.830129 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.830133 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.830216 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.830237 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.830308 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.830380 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":126,"threads_started":1}
I20260811 11:45:31.830590 30454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.825103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50250 (local address 127.20.244.66:44491)
0811 11:45:31.825522 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.825534 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.825556 (+ 22us) server_negotiation.cc:407] Connection header received
0811 11:45:31.825644 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.825652 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.825822 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.825984 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:31.826238 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.827336 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.828743 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.829836 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.829948 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.830070 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.830361 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.830457 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":112,"threads_started":1}
I20260811 11:45:31.832089 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.825172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:32783 (local address 127.0.0.1:40686)
0811 11:45:31.825493 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.825507 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.825593 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.827910 (+ 2317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.827913 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.827930 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:31.828007 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.828013 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.829323 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.829327 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.830416 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.830425 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.831718 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.831721 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.831796 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.831813 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.831905 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.831973 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":103,"threads_started":1}
I20260811 11:45:31.832180 30457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.825325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40686 (local address 127.20.244.67:32783)
0811 11:45:31.827334 (+ 2009us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.827353 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.827376 (+ 23us) server_negotiation.cc:407] Connection header received
0811 11:45:31.827460 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.827465 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.827641 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.827779 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:31.828129 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.829195 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.830560 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.831405 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.831521 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.831654 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.831947 (+ 293us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.832037 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1915,"thread_start_us":124,"threads_started":1}
I20260811 11:45:31.832569 29995 tablet_service.cc:1467] Processing CreateTablet for tablet 2faeacf2f2c2442c8559dd9f2b5de30c (DEFAULT_TABLE table=test-table [id=9bb8b0f353074b9d8069f38e1ceebbf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:31.833711 29995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2faeacf2f2c2442c8559dd9f2b5de30c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:31.834700 30336 tablet_service.cc:1467] Processing CreateTablet for tablet 2faeacf2f2c2442c8559dd9f2b5de30c (DEFAULT_TABLE table=test-table [id=9bb8b0f353074b9d8069f38e1ceebbf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:31.835738 30336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2faeacf2f2c2442c8559dd9f2b5de30c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:31.836894 30164 tablet_service.cc:1467] Processing CreateTablet for tablet 2faeacf2f2c2442c8559dd9f2b5de30c (DEFAULT_TABLE table=test-table [id=9bb8b0f353074b9d8069f38e1ceebbf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:31.837673 30164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2faeacf2f2c2442c8559dd9f2b5de30c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:31.842609 30458 tablet_bootstrap.cc:492] T 2faeacf2f2c2442c8559dd9f2b5de30c P 09025679fb854a8dadd0ff0e1952e5f9: Bootstrap starting.
I20260811 11:45:31.843304 30460 tablet_bootstrap.cc:492] T 2faeacf2f2c2442c8559dd9f2b5de30c P c261356616aa44aca005f79e87745598: Bootstrap starting.
I20260811 11:45:31.844237 30461 tablet_bootstrap.cc:492] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b: Bootstrap starting.
I20260811 11:45:31.844904 30458 tablet_bootstrap.cc:654] T 2faeacf2f2c2442c8559dd9f2b5de30c P 09025679fb854a8dadd0ff0e1952e5f9: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:31.845733 30460 tablet_bootstrap.cc:654] T 2faeacf2f2c2442c8559dd9f2b5de30c P c261356616aa44aca005f79e87745598: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:31.845794 30458 log.cc:824] T 2faeacf2f2c2442c8559dd9f2b5de30c P 09025679fb854a8dadd0ff0e1952e5f9: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:31.846266 30461 tablet_bootstrap.cc:654] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:31.846565 30460 log.cc:824] T 2faeacf2f2c2442c8559dd9f2b5de30c P c261356616aa44aca005f79e87745598: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:31.847177 30461 log.cc:824] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:31.848090 30458 tablet_bootstrap.cc:492] T 2faeacf2f2c2442c8559dd9f2b5de30c P 09025679fb854a8dadd0ff0e1952e5f9: No bootstrap required, opened a new log
I20260811 11:45:31.848277 30458 ts_tablet_manager.cc:1397] T 2faeacf2f2c2442c8559dd9f2b5de30c P 09025679fb854a8dadd0ff0e1952e5f9: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 11:45:31.849009 30460 tablet_bootstrap.cc:492] T 2faeacf2f2c2442c8559dd9f2b5de30c P c261356616aa44aca005f79e87745598: No bootstrap required, opened a new log
I20260811 11:45:31.849076 30461 tablet_bootstrap.cc:492] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b: No bootstrap required, opened a new log
I20260811 11:45:31.849197 30460 ts_tablet_manager.cc:1397] T 2faeacf2f2c2442c8559dd9f2b5de30c P c261356616aa44aca005f79e87745598: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 11:45:31.849251 30461 ts_tablet_manager.cc:1397] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 11:45:31.852448 30460 raft_consensus.cc:348] T 2faeacf2f2c2442c8559dd9f2b5de30c P c261356616aa44aca005f79e87745598 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261356616aa44aca005f79e87745598" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 32783 } } peers { permanent_uuid: "09025679fb854a8dadd0ff0e1952e5f9" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 45231 } } peers { permanent_uuid: "f902f72b2c094219b426f4a0cd80529b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44491 } }
I20260811 11:45:31.852675 30460 raft_consensus.cc:374] T 2faeacf2f2c2442c8559dd9f2b5de30c P c261356616aa44aca005f79e87745598 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:31.852730 30460 raft_consensus.cc:729] T 2faeacf2f2c2442c8559dd9f2b5de30c P c261356616aa44aca005f79e87745598 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c261356616aa44aca005f79e87745598, State: Initialized, Role: FOLLOWER
I20260811 11:45:31.852981 30458 raft_consensus.cc:348] T 2faeacf2f2c2442c8559dd9f2b5de30c P 09025679fb854a8dadd0ff0e1952e5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261356616aa44aca005f79e87745598" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 32783 } } peers { permanent_uuid: "09025679fb854a8dadd0ff0e1952e5f9" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 45231 } } peers { permanent_uuid: "f902f72b2c094219b426f4a0cd80529b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44491 } }
I20260811 11:45:31.853231 30458 raft_consensus.cc:374] T 2faeacf2f2c2442c8559dd9f2b5de30c P 09025679fb854a8dadd0ff0e1952e5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:31.853297 30458 raft_consensus.cc:729] T 2faeacf2f2c2442c8559dd9f2b5de30c P 09025679fb854a8dadd0ff0e1952e5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09025679fb854a8dadd0ff0e1952e5f9, State: Initialized, Role: FOLLOWER
I20260811 11:45:31.853197 30460 consensus_queue.cc:260] T 2faeacf2f2c2442c8559dd9f2b5de30c P c261356616aa44aca005f79e87745598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261356616aa44aca005f79e87745598" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 32783 } } peers { permanent_uuid: "09025679fb854a8dadd0ff0e1952e5f9" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 45231 } } peers { permanent_uuid: "f902f72b2c094219b426f4a0cd80529b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44491 } }
I20260811 11:45:31.853724 30461 raft_consensus.cc:348] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261356616aa44aca005f79e87745598" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 32783 } } peers { permanent_uuid: "09025679fb854a8dadd0ff0e1952e5f9" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 45231 } } peers { permanent_uuid: "f902f72b2c094219b426f4a0cd80529b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44491 } }
I20260811 11:45:31.853969 30461 raft_consensus.cc:374] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:31.854022 30461 raft_consensus.cc:729] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f902f72b2c094219b426f4a0cd80529b, State: Initialized, Role: FOLLOWER
I20260811 11:45:31.854313 30460 ts_tablet_manager.cc:1428] T 2faeacf2f2c2442c8559dd9f2b5de30c P c261356616aa44aca005f79e87745598: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 11:45:31.854429 30461 consensus_queue.cc:260] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261356616aa44aca005f79e87745598" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 32783 } } peers { permanent_uuid: "09025679fb854a8dadd0ff0e1952e5f9" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 45231 } } peers { permanent_uuid: "f902f72b2c094219b426f4a0cd80529b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44491 } }
I20260811 11:45:31.854713 30423 heartbeater.cc:503] Master 127.20.244.126:33249 was elected leader, sending a full tablet report...
I20260811 11:45:31.855289 30458 consensus_queue.cc:260] T 2faeacf2f2c2442c8559dd9f2b5de30c P 09025679fb854a8dadd0ff0e1952e5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261356616aa44aca005f79e87745598" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 32783 } } peers { permanent_uuid: "09025679fb854a8dadd0ff0e1952e5f9" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 45231 } } peers { permanent_uuid: "f902f72b2c094219b426f4a0cd80529b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44491 } }
I20260811 11:45:31.855412 30461 ts_tablet_manager.cc:1428] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 11:45:31.856175 30458 ts_tablet_manager.cc:1428] T 2faeacf2f2c2442c8559dd9f2b5de30c P 09025679fb854a8dadd0ff0e1952e5f9: Time spent starting tablet: real 0.008s user 0.003s sys 0.004s
I20260811 11:45:31.857414 30250 heartbeater.cc:503] Master 127.20.244.126:33249 was elected leader, sending a full tablet report...
I20260811 11:45:31.857802 30079 heartbeater.cc:503] Master 127.20.244.126:33249 was elected leader, sending a full tablet report...
I20260811 11:45:31.877715 30467 raft_consensus.cc:482] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:45:31.877897 30467 raft_consensus.cc:504] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261356616aa44aca005f79e87745598" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 32783 } } peers { permanent_uuid: "09025679fb854a8dadd0ff0e1952e5f9" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 45231 } } peers { permanent_uuid: "f902f72b2c094219b426f4a0cd80529b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44491 } }
I20260811 11:45:31.878966 30467 leader_election.cc:288] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c261356616aa44aca005f79e87745598 (127.20.244.67:32783), 09025679fb854a8dadd0ff0e1952e5f9 (127.20.244.65:45231)
I20260811 11:45:31.882916 30457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.879243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:48395 (local address 127.20.244.67:32783)
0811 11:45:31.879355 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.879365 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.879537 (+ 172us) server_negotiation.cc:407] Connection header received
0811 11:45:31.879693 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.879697 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.879744 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.879826 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:31.880150 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.880648 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.881701 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.882259 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.882387 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.882439 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.882703 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.882798 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 11:45:31.882906 30257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.879162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:32783 (local address 127.20.244.66:48395)
0811 11:45:31.879444 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.879459 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.879582 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.879847 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.879850 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.879865 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:31.880029 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.880035 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.880759 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.880764 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.881571 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.881581 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.882492 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.882494 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.882569 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.882587 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.882687 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.882762 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":59,"spinlock_wait_cycles":384}
I20260811 11:45:31.883052 30256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.879253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:45231 (local address 127.20.244.66:44733)
0811 11:45:31.879463 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:31.879477 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:31.879566 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:31.879830 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:31.879833 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:31.879849 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:31.880009 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.880015 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.880745 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.880748 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.881555 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:31.881564 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.882530 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.882533 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:31.882652 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.882684 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 11:45:31.882773 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 11:45:31.882835 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":10,"spinlock_wait_cycles":3328}
I20260811 11:45:31.883231 30452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.879384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:44733 (local address 127.20.244.65:45231)
0811 11:45:31.879523 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.879528 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.879542 (+ 14us) server_negotiation.cc:407] Connection header received
0811 11:45:31.879678 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.879684 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.879727 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.879805 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:31.880127 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.880631 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.881692 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.882283 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.882418 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.882467 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.882984 (+ 517us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.883064 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 11:45:31.883845 30019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2faeacf2f2c2442c8559dd9f2b5de30c" candidate_uuid: "f902f72b2c094219b426f4a0cd80529b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09025679fb854a8dadd0ff0e1952e5f9" is_pre_election: true
I20260811 11:45:31.884135 30359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2faeacf2f2c2442c8559dd9f2b5de30c" candidate_uuid: "f902f72b2c094219b426f4a0cd80529b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c261356616aa44aca005f79e87745598" is_pre_election: true
I20260811 11:45:31.884202 30019 raft_consensus.cc:2454] T 2faeacf2f2c2442c8559dd9f2b5de30c P 09025679fb854a8dadd0ff0e1952e5f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f902f72b2c094219b426f4a0cd80529b in term 0.
I20260811 11:45:31.884438 30359 raft_consensus.cc:2454] T 2faeacf2f2c2442c8559dd9f2b5de30c P c261356616aa44aca005f79e87745598 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f902f72b2c094219b426f4a0cd80529b in term 0.
I20260811 11:45:31.884649 30105 leader_election.cc:302] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09025679fb854a8dadd0ff0e1952e5f9, f902f72b2c094219b426f4a0cd80529b; no voters:
I20260811 11:45:31.884930 30467 raft_consensus.cc:2781] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:45:31.885015 30467 raft_consensus.cc:482] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:45:31.885058 30467 raft_consensus.cc:3037] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:31.886132 30467 raft_consensus.cc:504] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261356616aa44aca005f79e87745598" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 32783 } } peers { permanent_uuid: "09025679fb854a8dadd0ff0e1952e5f9" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 45231 } } peers { permanent_uuid: "f902f72b2c094219b426f4a0cd80529b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44491 } }
I20260811 11:45:31.886466 30467 leader_election.cc:288] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b [CANDIDATE]: Term 1 election: Requested vote from peers c261356616aa44aca005f79e87745598 (127.20.244.67:32783), 09025679fb854a8dadd0ff0e1952e5f9 (127.20.244.65:45231)
I20260811 11:45:31.886768 30359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2faeacf2f2c2442c8559dd9f2b5de30c" candidate_uuid: "f902f72b2c094219b426f4a0cd80529b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c261356616aa44aca005f79e87745598"
I20260811 11:45:31.886824 30019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2faeacf2f2c2442c8559dd9f2b5de30c" candidate_uuid: "f902f72b2c094219b426f4a0cd80529b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09025679fb854a8dadd0ff0e1952e5f9"
I20260811 11:45:31.886914 30359 raft_consensus.cc:3037] T 2faeacf2f2c2442c8559dd9f2b5de30c P c261356616aa44aca005f79e87745598 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:31.886972 30019 raft_consensus.cc:3037] T 2faeacf2f2c2442c8559dd9f2b5de30c P 09025679fb854a8dadd0ff0e1952e5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:31.887965 30359 raft_consensus.cc:2454] T 2faeacf2f2c2442c8559dd9f2b5de30c P c261356616aa44aca005f79e87745598 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f902f72b2c094219b426f4a0cd80529b in term 1.
I20260811 11:45:31.888015 30019 raft_consensus.cc:2454] T 2faeacf2f2c2442c8559dd9f2b5de30c P 09025679fb854a8dadd0ff0e1952e5f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f902f72b2c094219b426f4a0cd80529b in term 1.
I20260811 11:45:31.888245 30106 leader_election.cc:302] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c261356616aa44aca005f79e87745598, f902f72b2c094219b426f4a0cd80529b; no voters:
I20260811 11:45:31.888440 30467 raft_consensus.cc:2781] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:31.888645 30467 raft_consensus.cc:686] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b [term 1 LEADER]: Becoming Leader. State: Replica: f902f72b2c094219b426f4a0cd80529b, State: Running, Role: LEADER
I20260811 11:45:31.888967 30467 consensus_queue.cc:237] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261356616aa44aca005f79e87745598" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 32783 } } peers { permanent_uuid: "09025679fb854a8dadd0ff0e1952e5f9" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 45231 } } peers { permanent_uuid: "f902f72b2c094219b426f4a0cd80529b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44491 } }
I20260811 11:45:31.892403 28868 catalog_manager.cc:5495] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b reported cstate change: term changed from 0 to 1, leader changed from <none> to f902f72b2c094219b426f4a0cd80529b (127.20.244.66). New cstate: current_term: 1 leader_uuid: "f902f72b2c094219b426f4a0cd80529b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261356616aa44aca005f79e87745598" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 32783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09025679fb854a8dadd0ff0e1952e5f9" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 45231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f902f72b2c094219b426f4a0cd80529b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44491 } health_report { overall_health: HEALTHY } } }
I20260811 11:45:31.906142 30454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.902863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50264 (local address 127.20.244.66:44491)
0811 11:45:31.902994 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.902998 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.903010 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:45:31.903121 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.903123 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.903180 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.903344 (+ 164us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:45:31.903604 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.904100 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.904887 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.905095 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.905171 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.905420 (+ 249us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:45:31.905822 (+ 402us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:45:31.905910 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.905967 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.906015 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 11:45:31.912096 30019 raft_consensus.cc:1261] T 2faeacf2f2c2442c8559dd9f2b5de30c P 09025679fb854a8dadd0ff0e1952e5f9 [term 1 FOLLOWER]: Refusing update from remote peer f902f72b2c094219b426f4a0cd80529b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:31.912110 30359 raft_consensus.cc:1261] T 2faeacf2f2c2442c8559dd9f2b5de30c P c261356616aa44aca005f79e87745598 [term 1 FOLLOWER]: Refusing update from remote peer f902f72b2c094219b426f4a0cd80529b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:31.912844 30469 consensus_queue.cc:1035] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c261356616aa44aca005f79e87745598" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 32783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:31.913033 30467 consensus_queue.cc:1035] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09025679fb854a8dadd0ff0e1952e5f9" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 45231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:31.923753 30474 mvcc.cc:205] Tried to move back new op lower bound from 7317294005904310272 to 7317294005819662336. Current Snapshot: MvccSnapshot[applied={T|T < 7317294005904310272}]
I20260811 11:45:31.934969 28868 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:31.935230 28868 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:31.939749 28868 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dc3a5b075c0b4be29c9047591ab3d38c: Sending DeleteTablet for 3 replicas of tablet 2faeacf2f2c2442c8559dd9f2b5de30c
I20260811 11:45:31.940708 30164 tablet_service.cc:1514] Processing DeleteTablet for tablet 2faeacf2f2c2442c8559dd9f2b5de30c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:31 UTC) from {username='oryx', principal='oryx/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:50250
I20260811 11:45:31.940882 29995 tablet_service.cc:1514] Processing DeleteTablet for tablet 2faeacf2f2c2442c8559dd9f2b5de30c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:31 UTC) from {username='oryx', principal='oryx/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:36654
I20260811 11:45:31.941254 30487 tablet_replica.cc:330] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b: stopping tablet replica
I20260811 11:45:31.941402 30336 tablet_service.cc:1514] Processing DeleteTablet for tablet 2faeacf2f2c2442c8559dd9f2b5de30c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:31 UTC) from {username='oryx', principal='oryx/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:40686
I20260811 11:45:31.941579 30487 raft_consensus.cc:2229] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:45:31.941987 30487 raft_consensus.cc:2258] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:31.942355 30490 tablet_replica.cc:330] T 2faeacf2f2c2442c8559dd9f2b5de30c P c261356616aa44aca005f79e87745598: stopping tablet replica
I20260811 11:45:31.942013 30489 tablet_replica.cc:330] T 2faeacf2f2c2442c8559dd9f2b5de30c P 09025679fb854a8dadd0ff0e1952e5f9: stopping tablet replica
I20260811 11:45:31.942785 30489 raft_consensus.cc:2229] T 2faeacf2f2c2442c8559dd9f2b5de30c P 09025679fb854a8dadd0ff0e1952e5f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:31.943563 30489 raft_consensus.cc:2258] T 2faeacf2f2c2442c8559dd9f2b5de30c P 09025679fb854a8dadd0ff0e1952e5f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:31.943630 30487 ts_tablet_manager.cc:1905] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:31.943676 30490 raft_consensus.cc:2229] T 2faeacf2f2c2442c8559dd9f2b5de30c P c261356616aa44aca005f79e87745598 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:31.944041 30490 raft_consensus.cc:2258] T 2faeacf2f2c2442c8559dd9f2b5de30c P c261356616aa44aca005f79e87745598 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:31.944519 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 28834
I20260811 11:45:31.949298 30490 ts_tablet_manager.cc:1905] T 2faeacf2f2c2442c8559dd9f2b5de30c P c261356616aa44aca005f79e87745598: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:31.950588 30487 ts_tablet_manager.cc:1918] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:45:31.950695 30487 log.cc:1196] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/2faeacf2f2c2442c8559dd9f2b5de30c
I20260811 11:45:31.951046 30487 ts_tablet_manager.cc:1939] T 2faeacf2f2c2442c8559dd9f2b5de30c P f902f72b2c094219b426f4a0cd80529b: Deleting consensus metadata
I20260811 11:45:31.952996 30490 ts_tablet_manager.cc:1918] T 2faeacf2f2c2442c8559dd9f2b5de30c P c261356616aa44aca005f79e87745598: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:45:31.953459 30489 ts_tablet_manager.cc:1905] T 2faeacf2f2c2442c8559dd9f2b5de30c P 09025679fb854a8dadd0ff0e1952e5f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:31.953523 30490 log.cc:1196] T 2faeacf2f2c2442c8559dd9f2b5de30c P c261356616aa44aca005f79e87745598: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/2faeacf2f2c2442c8559dd9f2b5de30c
I20260811 11:45:31.954135 30490 ts_tablet_manager.cc:1939] T 2faeacf2f2c2442c8559dd9f2b5de30c P c261356616aa44aca005f79e87745598: Deleting consensus metadata
W20260811 11:45:31.956846 30105 connection.cc:535] server connection from 127.0.0.1:50250 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 11:45:31.956859 30283 connection.cc:535] server connection from 127.0.0.1:40686 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 11:45:31.956984 30489 ts_tablet_manager.cc:1918] T 2faeacf2f2c2442c8559dd9f2b5de30c P 09025679fb854a8dadd0ff0e1952e5f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:45:31.957087 30489 log.cc:1196] T 2faeacf2f2c2442c8559dd9f2b5de30c P 09025679fb854a8dadd0ff0e1952e5f9: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-0/wal/wals/2faeacf2f2c2442c8559dd9f2b5de30c
I20260811 11:45:31.957463 30489 ts_tablet_manager.cc:1939] T 2faeacf2f2c2442c8559dd9f2b5de30c P 09025679fb854a8dadd0ff0e1952e5f9: Deleting consensus metadata
W20260811 11:45:31.958603 29939 connection.cc:441] server connection from 127.0.0.1:36654 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36654 (request call id 1) could send its response
I20260811 11:45:31.965827 30436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.943234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52392 (local address 127.20.244.125:37843)
0811 11:45:31.943368 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.943373 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.953336 (+ 9963us) server_negotiation.cc:407] Connection header received
0811 11:45:31.953474 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.953478 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.953544 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.953635 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.954868 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.955783 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.958484 (+ 2701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.958817 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.958940 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.961154 (+ 2214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.961159 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.961163 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.961193 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.963417 (+ 2224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.963977 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.963981 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.963983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.964075 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.964422 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.964426 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.964427 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.964941 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.965056 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.965487 (+ 431us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.965633 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35,"spinlock_wait_cycles":1408}
I20260811 11:45:31.976568 29772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.960877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52408 (local address 127.20.244.125:37843)
0811 11:45:31.961097 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.961104 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.961685 (+ 581us) server_negotiation.cc:407] Connection header received
0811 11:45:31.961792 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.961795 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.961837 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.961932 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.962535 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.963170 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.964045 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.964274 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.964386 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.968067 (+ 3681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.968071 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.968073 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.968097 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.969694 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.975285 (+ 5591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.975289 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.975290 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.975373 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.975671 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.975674 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.975675 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.975862 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.975960 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.976291 (+ 331us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.976414 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"spinlock_wait_cycles":1792}
I20260811 11:45:31.978185 30439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.943300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49468 (local address 127.20.244.124:44973)
0811 11:45:31.943426 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.943430 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.966626 (+ 23196us) server_negotiation.cc:407] Connection header received
0811 11:45:31.966680 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.966683 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.966735 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.966809 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.969997 (+ 3188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.970716 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.972117 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.972472 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.972542 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.974234 (+ 1692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.974238 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.974241 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.974265 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.976147 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.976681 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.976686 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.976688 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.976778 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.977098 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.977102 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.977104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.977334 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.977458 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.977900 (+ 442us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.978032 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 11:45:31.980410 30082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:31.961204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49478 (local address 127.20.244.124:44973)
0811 11:45:31.961341 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:31.961345 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:31.966860 (+ 5515us) server_negotiation.cc:407] Connection header received
0811 11:45:31.967054 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:31.967058 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:31.967224 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:31.967297 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:31.968287 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.969066 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.970311 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:31.970653 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:31.970733 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:31.972489 (+ 1756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:31.972493 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:31.972496 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:31.972526 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:31.974960 (+ 2434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.979112 (+ 4152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.979116 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.979118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.979201 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:31.979563 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:31.979566 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:31.979568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:31.979769 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:31.979891 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:31.980136 (+ 245us) server_negotiation.cc:299] Negotiation successful
0811 11:45:31.980246 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 11:45:32.928369 30501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:32.927768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.65:46585)
0811 11:45:32.928132 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:32.928231 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":103,"threads_started":1}
I20260811 11:45:32.928520 30502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:32.927896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.67:56121)
0811 11:45:32.928214 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:32.928331 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":74,"threads_started":1}
W20260811 11:45:32.928691 30079 heartbeater.cc:644] Failed to heartbeat to 127.20.244.126:33249 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
W20260811 11:45:32.928822 30423 heartbeater.cc:644] Failed to heartbeat to 127.20.244.126:33249 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
I20260811 11:45:32.929353 30503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:32.928016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.66:54391)
0811 11:45:32.929172 (+ 1156us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:32.929274 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1079,"thread_start_us":65,"threads_started":1}
W20260811 11:45:32.929602 30250 heartbeater.cc:644] Failed to heartbeat to 127.20.244.126:33249 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
I20260811 11:45:33.440274 30504 raft_consensus.cc:482] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dc3a5b075c0b4be29c9047591ab3d38c)
I20260811 11:45:33.440527 30504 raft_consensus.cc:504] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: false } }
I20260811 11:45:33.440598 30506 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dc3a5b075c0b4be29c9047591ab3d38c)
I20260811 11:45:33.440800 30506 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: false } }
I20260811 11:45:33.441578 30504 leader_election.cc:288] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dc3a5b075c0b4be29c9047591ab3d38c (127.20.244.126:33249), 0977a806ce7e43ccbc582c3022abedcf (127.20.244.124:44973)
I20260811 11:45:33.441879 30506 leader_election.cc:288] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dc3a5b075c0b4be29c9047591ab3d38c (127.20.244.126:33249), 069975cd170f4e85883ae295691c6046 (127.20.244.125:37843)
I20260811 11:45:33.442487 30509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:33.442047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.0.0.1:57424)
0811 11:45:33.442275 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:33.442376 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":58,"threads_started":1}
W20260811 11:45:33.442762 29828 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
I20260811 11:45:33.442842 30507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:33.441808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.0.0.1:57416)
0811 11:45:33.442670 (+ 862us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:33.442745 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":799,"mutex_wait_us":46,"thread_start_us":71,"threads_started":1}
W20260811 11:45:33.443045 29598 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
I20260811 11:45:33.443920 30507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:33.443668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.0.0.1:57448)
0811 11:45:33.443805 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:33.443858 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 11:45:33.443921 30509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:33.443677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.0.0.1:57436)
0811 11:45:33.443809 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:33.443856 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260811 11:45:33.444022 29598 leader_election.cc:334] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc3a5b075c0b4be29c9047591ab3d38c (127.20.244.126:33249): Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
W20260811 11:45:33.444169 29828 leader_election.cc:334] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc3a5b075c0b4be29c9047591ab3d38c (127.20.244.126:33249): Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
I20260811 11:45:33.446101 30508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:33.441803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44973 (local address 127.0.0.1:49490)
0811 11:45:33.442113 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:33.442131 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:33.442242 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:33.442663 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:33.442666 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:33.442684 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:33.442803 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:33.442810 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:33.443872 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:33.443875 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:33.445102 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:33.445114 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:33.445798 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:33.445801 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:33.445868 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:33.445888 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 11:45:33.445946 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 11:45:33.446001 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"mutex_wait_us":3,"thread_start_us":70,"threads_started":1}
I20260811 11:45:33.446161 30510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:33.442128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49490 (local address 127.20.244.124:44973)
0811 11:45:33.442332 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:33.442337 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:33.442352 (+ 15us) server_negotiation.cc:407] Connection header received
0811 11:45:33.442401 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:33.442404 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:33.442452 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:33.442540 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:33.442942 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:33.443729 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:33.445228 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:33.445675 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:33.445790 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:33.445840 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:33.445982 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 11:45:33.446050 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":71,"threads_started":1}
I20260811 11:45:33.446848 30511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:33.442401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:37843 (local address 127.0.0.1:52418)
0811 11:45:33.442840 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:33.442853 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:33.443004 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:33.443411 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:33.443414 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:33.443432 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:33.443520 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:33.443529 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:33.444528 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:33.444532 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:33.445550 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:33.445560 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:33.446482 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:33.446488 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:33.446586 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:33.446609 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 11:45:33.446690 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 11:45:33.446755 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":77,"threads_started":1}
I20260811 11:45:33.446837 29860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "069975cd170f4e85883ae295691c6046" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "0977a806ce7e43ccbc582c3022abedcf" is_pre_election: true
I20260811 11:45:33.446943 30512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:33.442472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52418 (local address 127.20.244.125:37843)
0811 11:45:33.442713 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:33.442717 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:33.442929 (+ 212us) server_negotiation.cc:407] Connection header received
0811 11:45:33.443172 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:33.443178 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:33.443219 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:33.443272 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:33.443663 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:33.444408 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:33.445669 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:33.446285 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:33.446471 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:33.446526 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:33.446728 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 11:45:33.446795 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":59,"threads_started":1}
I20260811 11:45:33.447052 29860 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069975cd170f4e85883ae295691c6046 in term 1.
I20260811 11:45:33.447455 29601 leader_election.cc:302] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069975cd170f4e85883ae295691c6046, 0977a806ce7e43ccbc582c3022abedcf; no voters: dc3a5b075c0b4be29c9047591ab3d38c
I20260811 11:45:33.447456 29639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0977a806ce7e43ccbc582c3022abedcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "069975cd170f4e85883ae295691c6046" is_pre_election: true
I20260811 11:45:33.447664 29639 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0977a806ce7e43ccbc582c3022abedcf in term 1.
I20260811 11:45:33.447741 30504 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 11:45:33.447801 30504 raft_consensus.cc:482] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dc3a5b075c0b4be29c9047591ab3d38c)
I20260811 11:45:33.447841 30504 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 1 FOLLOWER]: Advancing to term 2
I20260811 11:45:33.447978 29829 leader_election.cc:302] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069975cd170f4e85883ae295691c6046, 0977a806ce7e43ccbc582c3022abedcf; no voters: dc3a5b075c0b4be29c9047591ab3d38c
I20260811 11:45:33.448171 30506 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 11:45:33.448225 30506 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 1 FOLLOWER]: Starting leader election (detected failure of leader dc3a5b075c0b4be29c9047591ab3d38c)
I20260811 11:45:33.448262 30506 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 1 FOLLOWER]: Advancing to term 2
I20260811 11:45:33.449162 30504 raft_consensus.cc:504] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: false } }
I20260811 11:45:33.449563 30504 leader_election.cc:288] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [CANDIDATE]: Term 2 election: Requested vote from peers dc3a5b075c0b4be29c9047591ab3d38c (127.20.244.126:33249), 0977a806ce7e43ccbc582c3022abedcf (127.20.244.124:44973)
I20260811 11:45:33.449517 30506 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: false } }
I20260811 11:45:33.449903 30506 leader_election.cc:288] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [CANDIDATE]: Term 2 election: Requested vote from peers dc3a5b075c0b4be29c9047591ab3d38c (127.20.244.126:33249), 069975cd170f4e85883ae295691c6046 (127.20.244.125:37843)
I20260811 11:45:33.449927 29860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "069975cd170f4e85883ae295691c6046" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "0977a806ce7e43ccbc582c3022abedcf"
I20260811 11:45:33.450080 29860 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 069975cd170f4e85883ae295691c6046 in current term 2: Already voted for candidate 0977a806ce7e43ccbc582c3022abedcf in this term.
I20260811 11:45:33.450282 30511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:33.450047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.0.0.1:57470)
0811 11:45:33.450156 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:33.450210 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 11:45:33.450497 29639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0977a806ce7e43ccbc582c3022abedcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "069975cd170f4e85883ae295691c6046"
I20260811 11:45:33.450662 29639 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0977a806ce7e43ccbc582c3022abedcf in current term 2: Already voted for candidate 069975cd170f4e85883ae295691c6046 in this term.
I20260811 11:45:33.450891 30511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:33.450677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.0.0.1:57486)
0811 11:45:33.450786 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:33.450833 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 11:45:33.450989 29828 leader_election.cc:334] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dc3a5b075c0b4be29c9047591ab3d38c (127.20.244.126:33249): Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
I20260811 11:45:33.451061 29828 leader_election.cc:302] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0977a806ce7e43ccbc582c3022abedcf; no voters: 069975cd170f4e85883ae295691c6046, dc3a5b075c0b4be29c9047591ab3d38c
I20260811 11:45:33.451193 30508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:33.449679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.0.0.1:57460)
0811 11:45:33.451049 (+ 1370us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:33.451129 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1305}
I20260811 11:45:33.451232 30506 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 11:45:33.451879 30508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:33.451674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.0.0.1:57494)
0811 11:45:33.451791 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:33.451834 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 11:45:33.452026 29598 leader_election.cc:334] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dc3a5b075c0b4be29c9047591ab3d38c (127.20.244.126:33249): Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
I20260811 11:45:33.452114 29598 leader_election.cc:302] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069975cd170f4e85883ae295691c6046; no voters: 0977a806ce7e43ccbc582c3022abedcf, dc3a5b075c0b4be29c9047591ab3d38c
I20260811 11:45:33.452310 30504 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 11:45:33.929775 30515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:33.929256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.65:36873)
0811 11:45:33.929594 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:33.929663 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":107,"threads_started":1}
I20260811 11:45:33.930019 30517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:33.929338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.67:45817)
0811 11:45:33.929651 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:33.929697 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":98,"threads_started":1}
I20260811 11:45:33.930580 30518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:33.930087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.66:33021)
0811 11:45:33.930416 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:33.930483 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":74,"threads_started":1}
I20260811 11:45:34.931806 30520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:34.930887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.65:36769)
0811 11:45:34.931622 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:34.931694 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":652,"thread_start_us":70,"threads_started":1}
I20260811 11:45:34.931866 30521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:34.931274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.66:39113)
0811 11:45:34.931732 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:34.931781 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":99,"threads_started":1}
I20260811 11:45:34.932039 30519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:34.930739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.67:50283)
0811 11:45:34.931771 (+ 1032us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:34.931845 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":951,"thread_start_us":104,"threads_started":1}
I20260811 11:45:34.952055 30522 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:45:34.952224 30522 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: false } }
I20260811 11:45:34.952721 30522 leader_election.cc:288] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dc3a5b075c0b4be29c9047591ab3d38c (127.20.244.126:33249), 069975cd170f4e85883ae295691c6046 (127.20.244.125:37843)
I20260811 11:45:34.953145 29639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0977a806ce7e43ccbc582c3022abedcf" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "069975cd170f4e85883ae295691c6046" is_pre_election: true
I20260811 11:45:34.953236 30524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:34.952821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.0.0.1:57708)
0811 11:45:34.953067 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:34.953130 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":84,"threads_started":1}
I20260811 11:45:34.953300 29639 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0977a806ce7e43ccbc582c3022abedcf in term 2.
I20260811 11:45:34.953670 29829 leader_election.cc:302] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069975cd170f4e85883ae295691c6046, 0977a806ce7e43ccbc582c3022abedcf; no voters:
I20260811 11:45:34.953881 30522 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 11:45:34.953959 30522 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:45:34.954023 30522 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 2 FOLLOWER]: Advancing to term 3
I20260811 11:45:34.954151 30524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:34.953893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.0.0.1:57720)
0811 11:45:34.954031 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:34.954085 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 11:45:34.954269 29828 leader_election.cc:334] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dc3a5b075c0b4be29c9047591ab3d38c (127.20.244.126:33249): Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
I20260811 11:45:34.955350 30522 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: false } }
I20260811 11:45:34.955686 30522 leader_election.cc:288] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [CANDIDATE]: Term 3 election: Requested vote from peers dc3a5b075c0b4be29c9047591ab3d38c (127.20.244.126:33249), 069975cd170f4e85883ae295691c6046 (127.20.244.125:37843)
I20260811 11:45:34.956004 29639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0977a806ce7e43ccbc582c3022abedcf" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "069975cd170f4e85883ae295691c6046"
I20260811 11:45:34.956158 30524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:34.955856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.0.0.1:57734)
0811 11:45:34.956038 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:34.956079 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260811 11:45:34.956163 29639 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 2 FOLLOWER]: Advancing to term 3
I20260811 11:45:34.956804 30524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:34.956578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.0.0.1:57748)
0811 11:45:34.956700 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:34.956746 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260811 11:45:34.956905 29828 leader_election.cc:334] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer dc3a5b075c0b4be29c9047591ab3d38c (127.20.244.126:33249): Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
I20260811 11:45:34.957489 29639 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0977a806ce7e43ccbc582c3022abedcf in term 3.
I20260811 11:45:34.957795 29829 leader_election.cc:302] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069975cd170f4e85883ae295691c6046, 0977a806ce7e43ccbc582c3022abedcf; no voters: dc3a5b075c0b4be29c9047591ab3d38c
I20260811 11:45:34.958057 30522 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 3 FOLLOWER]: Leader election won for term 3
I20260811 11:45:34.958268 30522 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [term 3 LEADER]: Becoming Leader. State: Replica: 0977a806ce7e43ccbc582c3022abedcf, State: Running, Role: LEADER
I20260811 11:45:34.958549 30522 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: false } }
I20260811 11:45:34.960211 30526 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0977a806ce7e43ccbc582c3022abedcf. Latest consensus state: current_term: 3 leader_uuid: "0977a806ce7e43ccbc582c3022abedcf" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: false } } }
I20260811 11:45:34.960350 30526 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:34.960636 30528 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:45:34.963285 30528 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:45:34.963641 30528 catalog_manager.cc:1259] Loaded cluster ID: 099b90cae7d948e6920e7219d648152b
I20260811 11:45:34.963682 30528 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:45:34.964182 30528 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:45:34.964538 30528 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf: Loaded TSK: 0
I20260811 11:45:34.965214 30528 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:45:35.034078 29845 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49478:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:45:35.037245 29845 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:45:35.040447 29639 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [term 3 FOLLOWER]: Refusing update from remote peer 0977a806ce7e43ccbc582c3022abedcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260811 11:45:35.040496 30524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.040166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.0.0.1:57776)
0811 11:45:35.040371 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:35.040427 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260811 11:45:35.040933 30526 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 11:45:35.041265 30524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.041020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.0.0.1:57784)
0811 11:45:35.041141 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:35.041202 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 11:45:35.041430 29828 consensus_peers.cc:487] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf -> Peer dc3a5b075c0b4be29c9047591ab3d38c (127.20.244.126:33249): Couldn't send request to peer dc3a5b075c0b4be29c9047591ab3d38c. Status: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 11:45:35.042404 30531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0977a806ce7e43ccbc582c3022abedcf. Latest consensus state: current_term: 3 leader_uuid: "0977a806ce7e43ccbc582c3022abedcf" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: false } } }
I20260811 11:45:35.042567 30531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:45:35.043634 30526 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "0977a806ce7e43ccbc582c3022abedcf" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: false } } }
I20260811 11:45:35.043761 30526 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:35.044427 30531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "0977a806ce7e43ccbc582c3022abedcf" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc3a5b075c0b4be29c9047591ab3d38c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33249 } } peers { permanent_uuid: "069975cd170f4e85883ae295691c6046" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 37843 } attrs { promote: false } } peers { permanent_uuid: "0977a806ce7e43ccbc582c3022abedcf" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44973 } attrs { promote: false } } }
I20260811 11:45:35.044566 30531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 069975cd170f4e85883ae295691c6046 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:45:35.054988 30543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.049682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36666 (local address 127.20.244.65:45231)
0811 11:45:35.051687 (+ 2005us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:35.051694 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:35.051709 (+ 15us) server_negotiation.cc:407] Connection header received
0811 11:45:35.051758 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:35.051761 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:35.051806 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:35.051956 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:35.052204 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:35.052834 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:35.053965 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:35.054378 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:35.054493 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:35.054556 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:35.054790 (+ 234us) server_negotiation.cc:299] Negotiation successful
0811 11:45:35.054861 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1915,"thread_start_us":68,"threads_started":1}
I20260811 11:45:35.054986 30524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.049401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:32783 (local address 127.0.0.1:40698)
0811 11:45:35.049712 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:35.049727 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:35.049830 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:35.051143 (+ 1313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:35.051147 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:35.051168 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:35.051272 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:35.051280 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:35.052249 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:35.052254 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:35.053302 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:35.053313 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:35.054535 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:35.054539 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:35.054678 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:35.054699 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 11:45:35.054757 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 11:45:35.054839 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"mutex_wait_us":30}
I20260811 11:45:35.055006 30541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.049573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:45231 (local address 127.0.0.1:36666)
0811 11:45:35.049869 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:35.049881 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:35.049987 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:35.051987 (+ 2000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:35.051990 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:35.052008 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:35.052083 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:35.052088 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:35.052951 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:35.052956 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:35.053838 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:35.053848 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:35.054506 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:35.054509 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:35.054613 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:35.054672 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 11:45:35.054747 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 11:45:35.054814 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"mutex_wait_us":4,"thread_start_us":91,"threads_started":1}
I20260811 11:45:35.055642 29995 tablet_service.cc:1467] Processing CreateTablet for tablet 528ffb6a7aca43bfbcb3c85ff73586f4 (DEFAULT_TABLE table=test-table [id=28a051970f3b4b80bd9b9217a212215b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:35.055924 30544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.050068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:44491 (local address 127.0.0.1:50270)
0811 11:45:35.050525 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:35.050539 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:35.050619 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:35.051505 (+ 886us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:35.051508 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:35.051526 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:35.051607 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:35.051613 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:35.053427 (+ 1814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:35.053430 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:35.054561 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:35.054569 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:35.055529 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:35.055532 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:35.055624 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:35.055651 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 11:45:35.055725 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 11:45:35.055792 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"mutex_wait_us":1,"thread_start_us":98,"threads_started":1}
I20260811 11:45:35.055959 29995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 528ffb6a7aca43bfbcb3c85ff73586f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:35.055974 30545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.050213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50270 (local address 127.20.244.66:44491)
0811 11:45:35.051264 (+ 1051us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:35.051269 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:35.051284 (+ 15us) server_negotiation.cc:407] Connection header received
0811 11:45:35.051337 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:35.051342 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:35.051393 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:35.051481 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:35.051738 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:35.052510 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:35.054660 (+ 2150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:35.055410 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:35.055516 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:35.055572 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:35.055759 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 11:45:35.055836 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":976,"thread_start_us":89,"threads_started":1}
I20260811 11:45:35.056391 30540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.049490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40698 (local address 127.20.244.67:32783)
0811 11:45:35.050840 (+ 1350us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:35.050846 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:35.050860 (+ 14us) server_negotiation.cc:407] Connection header received
0811 11:45:35.050914 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:35.050917 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:35.050980 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:35.051057 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:35.051390 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:35.052124 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:35.053717 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:35.054406 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:35.055671 (+ 1265us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:35.055749 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:35.055854 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 11:45:35.055926 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1017,"thread_start_us":94,"threads_started":1}
I20260811 11:45:35.056643 30164 tablet_service.cc:1467] Processing CreateTablet for tablet 528ffb6a7aca43bfbcb3c85ff73586f4 (DEFAULT_TABLE table=test-table [id=28a051970f3b4b80bd9b9217a212215b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:35.056919 30164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 528ffb6a7aca43bfbcb3c85ff73586f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:35.057251 30336 tablet_service.cc:1467] Processing CreateTablet for tablet 528ffb6a7aca43bfbcb3c85ff73586f4 (DEFAULT_TABLE table=test-table [id=28a051970f3b4b80bd9b9217a212215b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:35.057525 30336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 528ffb6a7aca43bfbcb3c85ff73586f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:35.059000 30546 tablet_bootstrap.cc:492] T 528ffb6a7aca43bfbcb3c85ff73586f4 P 09025679fb854a8dadd0ff0e1952e5f9: Bootstrap starting.
I20260811 11:45:35.060159 30549 tablet_bootstrap.cc:492] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598: Bootstrap starting.
I20260811 11:45:35.060354 30546 tablet_bootstrap.cc:654] T 528ffb6a7aca43bfbcb3c85ff73586f4 P 09025679fb854a8dadd0ff0e1952e5f9: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:35.060400 30548 tablet_bootstrap.cc:492] T 528ffb6a7aca43bfbcb3c85ff73586f4 P f902f72b2c094219b426f4a0cd80529b: Bootstrap starting.
I20260811 11:45:35.060994 30549 tablet_bootstrap.cc:654] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:35.061358 30548 tablet_bootstrap.cc:654] T 528ffb6a7aca43bfbcb3c85ff73586f4 P f902f72b2c094219b426f4a0cd80529b: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:35.061715 30546 tablet_bootstrap.cc:492] T 528ffb6a7aca43bfbcb3c85ff73586f4 P 09025679fb854a8dadd0ff0e1952e5f9: No bootstrap required, opened a new log
I20260811 11:45:35.061812 30546 ts_tablet_manager.cc:1397] T 528ffb6a7aca43bfbcb3c85ff73586f4 P 09025679fb854a8dadd0ff0e1952e5f9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 11:45:35.062295 30546 raft_consensus.cc:348] T 528ffb6a7aca43bfbcb3c85ff73586f4 P 09025679fb854a8dadd0ff0e1952e5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261356616aa44aca005f79e87745598" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 32783 } } peers { permanent_uuid: "09025679fb854a8dadd0ff0e1952e5f9" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 45231 } } peers { permanent_uuid: "f902f72b2c094219b426f4a0cd80529b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44491 } }
I20260811 11:45:35.062388 30546 raft_consensus.cc:374] T 528ffb6a7aca43bfbcb3c85ff73586f4 P 09025679fb854a8dadd0ff0e1952e5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:35.062409 30546 raft_consensus.cc:729] T 528ffb6a7aca43bfbcb3c85ff73586f4 P 09025679fb854a8dadd0ff0e1952e5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09025679fb854a8dadd0ff0e1952e5f9, State: Initialized, Role: FOLLOWER
I20260811 11:45:35.062572 30546 consensus_queue.cc:260] T 528ffb6a7aca43bfbcb3c85ff73586f4 P 09025679fb854a8dadd0ff0e1952e5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261356616aa44aca005f79e87745598" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 32783 } } peers { permanent_uuid: "09025679fb854a8dadd0ff0e1952e5f9" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 45231 } } peers { permanent_uuid: "f902f72b2c094219b426f4a0cd80529b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44491 } }
I20260811 11:45:35.062958 30546 ts_tablet_manager.cc:1428] T 528ffb6a7aca43bfbcb3c85ff73586f4 P 09025679fb854a8dadd0ff0e1952e5f9: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 11:45:35.063246 30548 tablet_bootstrap.cc:492] T 528ffb6a7aca43bfbcb3c85ff73586f4 P f902f72b2c094219b426f4a0cd80529b: No bootstrap required, opened a new log
I20260811 11:45:35.063323 30548 ts_tablet_manager.cc:1397] T 528ffb6a7aca43bfbcb3c85ff73586f4 P f902f72b2c094219b426f4a0cd80529b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 11:45:35.063774 30548 raft_consensus.cc:348] T 528ffb6a7aca43bfbcb3c85ff73586f4 P f902f72b2c094219b426f4a0cd80529b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261356616aa44aca005f79e87745598" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 32783 } } peers { permanent_uuid: "09025679fb854a8dadd0ff0e1952e5f9" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 45231 } } peers { permanent_uuid: "f902f72b2c094219b426f4a0cd80529b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44491 } }
I20260811 11:45:35.063901 30548 raft_consensus.cc:374] T 528ffb6a7aca43bfbcb3c85ff73586f4 P f902f72b2c094219b426f4a0cd80529b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:35.063936 30548 raft_consensus.cc:729] T 528ffb6a7aca43bfbcb3c85ff73586f4 P f902f72b2c094219b426f4a0cd80529b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f902f72b2c094219b426f4a0cd80529b, State: Initialized, Role: FOLLOWER
I20260811 11:45:35.064093 30520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.063560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.65:39135)
0811 11:45:35.063959 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:35.064022 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318}
I20260811 11:45:35.064051 30548 consensus_queue.cc:260] T 528ffb6a7aca43bfbcb3c85ff73586f4 P f902f72b2c094219b426f4a0cd80529b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261356616aa44aca005f79e87745598" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 32783 } } peers { permanent_uuid: "09025679fb854a8dadd0ff0e1952e5f9" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 45231 } } peers { permanent_uuid: "f902f72b2c094219b426f4a0cd80529b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44491 } }
I20260811 11:45:35.064428 30548 ts_tablet_manager.cc:1428] T 528ffb6a7aca43bfbcb3c85ff73586f4 P f902f72b2c094219b426f4a0cd80529b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:35.065182 30520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.064947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.65:50989)
0811 11:45:35.065057 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:35.065109 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 11:45:35.065492 30521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.065104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.66:48939)
0811 11:45:35.065354 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:35.065412 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188}
I20260811 11:45:35.065675 30549 tablet_bootstrap.cc:492] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598: No bootstrap required, opened a new log
I20260811 11:45:35.065769 30549 ts_tablet_manager.cc:1397] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260811 11:45:35.066123 30549 raft_consensus.cc:348] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261356616aa44aca005f79e87745598" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 32783 } } peers { permanent_uuid: "09025679fb854a8dadd0ff0e1952e5f9" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 45231 } } peers { permanent_uuid: "f902f72b2c094219b426f4a0cd80529b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44491 } }
I20260811 11:45:35.066237 30549 raft_consensus.cc:374] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:35.066277 30549 raft_consensus.cc:729] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c261356616aa44aca005f79e87745598, State: Initialized, Role: FOLLOWER
I20260811 11:45:35.066412 30549 consensus_queue.cc:260] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261356616aa44aca005f79e87745598" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 32783 } } peers { permanent_uuid: "09025679fb854a8dadd0ff0e1952e5f9" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 45231 } } peers { permanent_uuid: "f902f72b2c094219b426f4a0cd80529b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44491 } }
I20260811 11:45:35.066607 30248 heartbeater.cc:503] Master 127.20.244.124:44973 was elected leader, sending a full tablet report...
I20260811 11:45:35.066787 30549 ts_tablet_manager.cc:1428] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:35.067479 30519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.067160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.67:45011)
0811 11:45:35.067385 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:35.067429 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147}
I20260811 11:45:35.068470 30519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.068191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.67:39565)
0811 11:45:35.068353 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:35.068404 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260811 11:45:35.068581 30422 heartbeater.cc:503] Master 127.20.244.124:44973 was elected leader, sending a full tablet report...
I20260811 11:45:35.068735 30521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.067167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.66:60313)
0811 11:45:35.068626 (+ 1459us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:35.068677 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1395}
W20260811 11:45:35.069610 30254 tablet.cc:2369] T 528ffb6a7aca43bfbcb3c85ff73586f4 P f902f72b2c094219b426f4a0cd80529b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:45:35.104101 30081 tablet.cc:2369] T 528ffb6a7aca43bfbcb3c85ff73586f4 P 09025679fb854a8dadd0ff0e1952e5f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:45:35.118832 30556 raft_consensus.cc:482] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:45:35.118969 30556 raft_consensus.cc:504] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261356616aa44aca005f79e87745598" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 32783 } } peers { permanent_uuid: "09025679fb854a8dadd0ff0e1952e5f9" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 45231 } } peers { permanent_uuid: "f902f72b2c094219b426f4a0cd80529b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44491 } }
I20260811 11:45:35.120153 30556 leader_election.cc:288] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09025679fb854a8dadd0ff0e1952e5f9 (127.20.244.65:45231), f902f72b2c094219b426f4a0cd80529b (127.20.244.66:44491)
I20260811 11:45:35.124028 30519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.120368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:45231 (local address 127.20.244.67:42427)
0811 11:45:35.120522 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:35.120539 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:35.120651 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:35.120934 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:35.120937 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:35.120959 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:35.121113 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:35.121120 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:35.121931 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:35.121936 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:35.122874 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:35.122884 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:35.123584 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:35.123588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:35.123695 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:35.123718 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 11:45:35.123817 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 11:45:35.123892 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 11:45:35.124028 30543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.120493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:42427 (local address 127.20.244.65:45231)
0811 11:45:35.120640 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:35.120645 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:35.120664 (+ 19us) server_negotiation.cc:407] Connection header received
0811 11:45:35.120751 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:35.120753 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:35.120793 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:35.120916 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:35.121233 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:35.121813 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:35.122994 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:35.123457 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:35.123586 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:35.123640 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:35.123833 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 11:45:35.123909 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 11:45:35.124414 30557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.120374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:44491 (local address 127.20.244.67:39067)
0811 11:45:35.120894 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:35.120905 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:35.121074 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:35.121363 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:35.121366 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:35.121381 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:35.121500 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:35.121505 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:35.122297 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:35.122302 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:35.123296 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:35.123306 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:35.123925 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:35.123929 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:35.124033 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:35.124051 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 11:45:35.124192 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 11:45:35.124269 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"mutex_wait_us":188,"thread_start_us":126,"threads_started":1}
I20260811 11:45:35.124459 30545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.120495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:39067 (local address 127.20.244.66:44491)
0811 11:45:35.120653 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:35.120660 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:35.120998 (+ 338us) server_negotiation.cc:407] Connection header received
0811 11:45:35.121212 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:35.121215 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:35.121256 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:35.121347 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:35.121615 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:35.122186 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:35.123413 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:35.123804 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:35.123931 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:35.123978 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:35.124239 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 11:45:35.124334 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 11:45:35.124570 30019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "528ffb6a7aca43bfbcb3c85ff73586f4" candidate_uuid: "c261356616aa44aca005f79e87745598" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09025679fb854a8dadd0ff0e1952e5f9" is_pre_election: true
I20260811 11:45:35.124744 30019 raft_consensus.cc:2454] T 528ffb6a7aca43bfbcb3c85ff73586f4 P 09025679fb854a8dadd0ff0e1952e5f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c261356616aa44aca005f79e87745598 in term 0.
I20260811 11:45:35.125058 30192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "528ffb6a7aca43bfbcb3c85ff73586f4" candidate_uuid: "c261356616aa44aca005f79e87745598" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f902f72b2c094219b426f4a0cd80529b" is_pre_election: true
I20260811 11:45:35.125164 30279 leader_election.cc:302] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09025679fb854a8dadd0ff0e1952e5f9, c261356616aa44aca005f79e87745598; no voters:
I20260811 11:45:35.125298 30192 raft_consensus.cc:2454] T 528ffb6a7aca43bfbcb3c85ff73586f4 P f902f72b2c094219b426f4a0cd80529b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c261356616aa44aca005f79e87745598 in term 0.
I20260811 11:45:35.125461 30556 raft_consensus.cc:2781] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:45:35.125543 30556 raft_consensus.cc:482] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:45:35.125598 30556 raft_consensus.cc:3037] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:35.126616 30556 raft_consensus.cc:504] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261356616aa44aca005f79e87745598" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 32783 } } peers { permanent_uuid: "09025679fb854a8dadd0ff0e1952e5f9" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 45231 } } peers { permanent_uuid: "f902f72b2c094219b426f4a0cd80529b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44491 } }
I20260811 11:45:35.126981 30556 leader_election.cc:288] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598 [CANDIDATE]: Term 1 election: Requested vote from peers 09025679fb854a8dadd0ff0e1952e5f9 (127.20.244.65:45231), f902f72b2c094219b426f4a0cd80529b (127.20.244.66:44491)
I20260811 11:45:35.127346 30019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "528ffb6a7aca43bfbcb3c85ff73586f4" candidate_uuid: "c261356616aa44aca005f79e87745598" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09025679fb854a8dadd0ff0e1952e5f9"
I20260811 11:45:35.127353 30192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "528ffb6a7aca43bfbcb3c85ff73586f4" candidate_uuid: "c261356616aa44aca005f79e87745598" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f902f72b2c094219b426f4a0cd80529b"
I20260811 11:45:35.127480 30019 raft_consensus.cc:3037] T 528ffb6a7aca43bfbcb3c85ff73586f4 P 09025679fb854a8dadd0ff0e1952e5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:35.127490 30192 raft_consensus.cc:3037] T 528ffb6a7aca43bfbcb3c85ff73586f4 P f902f72b2c094219b426f4a0cd80529b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:35.128469 30019 raft_consensus.cc:2454] T 528ffb6a7aca43bfbcb3c85ff73586f4 P 09025679fb854a8dadd0ff0e1952e5f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c261356616aa44aca005f79e87745598 in term 1.
I20260811 11:45:35.128567 30192 raft_consensus.cc:2454] T 528ffb6a7aca43bfbcb3c85ff73586f4 P f902f72b2c094219b426f4a0cd80529b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c261356616aa44aca005f79e87745598 in term 1.
I20260811 11:45:35.128731 30279 leader_election.cc:302] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09025679fb854a8dadd0ff0e1952e5f9, c261356616aa44aca005f79e87745598; no voters:
I20260811 11:45:35.128937 30556 raft_consensus.cc:2781] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:35.129174 30556 raft_consensus.cc:686] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598 [term 1 LEADER]: Becoming Leader. State: Replica: c261356616aa44aca005f79e87745598, State: Running, Role: LEADER
I20260811 11:45:35.129434 30556 consensus_queue.cc:237] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261356616aa44aca005f79e87745598" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 32783 } } peers { permanent_uuid: "09025679fb854a8dadd0ff0e1952e5f9" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 45231 } } peers { permanent_uuid: "f902f72b2c094219b426f4a0cd80529b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44491 } }
I20260811 11:45:35.129901 30557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.129687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.67:42655)
0811 11:45:35.129798 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:35.129848 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 11:45:35.131677 29847 catalog_manager.cc:5495] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598 reported cstate change: term changed from 0 to 1, leader changed from <none> to c261356616aa44aca005f79e87745598 (127.20.244.67). New cstate: current_term: 1 leader_uuid: "c261356616aa44aca005f79e87745598" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c261356616aa44aca005f79e87745598" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 32783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09025679fb854a8dadd0ff0e1952e5f9" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 45231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f902f72b2c094219b426f4a0cd80529b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44491 } health_report { overall_health: UNKNOWN } } }
I20260811 11:45:35.157202 30540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.153402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40706 (local address 127.20.244.67:32783)
0811 11:45:35.153533 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:35.153539 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:35.153597 (+ 58us) server_negotiation.cc:407] Connection header received
0811 11:45:35.153843 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:35.153845 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:35.153919 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:35.154038 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:45:35.154267 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:35.154780 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:35.155747 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:35.155971 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:35.156082 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:35.156367 (+ 285us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:45:35.156820 (+ 453us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:45:35.156948 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:35.157004 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 11:45:35.157061 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 11:45:35.160090 30019 raft_consensus.cc:1261] T 528ffb6a7aca43bfbcb3c85ff73586f4 P 09025679fb854a8dadd0ff0e1952e5f9 [term 1 FOLLOWER]: Refusing update from remote peer c261356616aa44aca005f79e87745598: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:35.160356 30192 raft_consensus.cc:1261] T 528ffb6a7aca43bfbcb3c85ff73586f4 P f902f72b2c094219b426f4a0cd80529b [term 1 FOLLOWER]: Refusing update from remote peer c261356616aa44aca005f79e87745598: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:35.160648 30556 consensus_queue.cc:1035] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09025679fb854a8dadd0ff0e1952e5f9" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 45231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:35.160955 30558 consensus_queue.cc:1035] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f902f72b2c094219b426f4a0cd80529b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:35.161742 30076 heartbeater.cc:503] Master 127.20.244.124:44973 was elected leader, sending a full tablet report...
I20260811 11:45:35.162227 30520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.161974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.65:34167)
0811 11:45:35.162087 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:35.162153 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 11:45:35.164371 30521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.164064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.66:58063)
0811 11:45:35.164215 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:35.164295 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260811 11:45:35.164855 30561 mvcc.cc:205] Tried to move back new op lower bound from 7317294019210506240 to 7317294019092922368. Current Snapshot: MvccSnapshot[applied={T|T < 7317294019210506240}]
I20260811 11:45:35.165617 30557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.165365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.67:59129)
0811 11:45:35.165487 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:35.165546 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 11:45:35.165740 30520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.165466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.65:40987)
0811 11:45:35.165618 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:35.165672 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260811 11:45:35.168325 30566 mvcc.cc:205] Tried to move back new op lower bound from 7317294019210506240 to 7317294019092922368. Current Snapshot: MvccSnapshot[applied={T|T < 7317294019210506240}]
I20260811 11:45:35.168536 30557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.168283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.67:44821)
0811 11:45:35.168422 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:35.168473 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260811 11:45:35.168629 30521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.168295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33249 (local address 127.20.244.66:46239)
0811 11:45:35.168515 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:35.168566 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158}
I20260811 11:45:35.176543 29847 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49478:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:35.176735 29847 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49478:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:35.180637 29847 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0977a806ce7e43ccbc582c3022abedcf: Sending DeleteTablet for 3 replicas of tablet 528ffb6a7aca43bfbcb3c85ff73586f4
I20260811 11:45:35.181279 30336 tablet_service.cc:1514] Processing DeleteTablet for tablet 528ffb6a7aca43bfbcb3c85ff73586f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:35 UTC) from {username='oryx', principal='oryx/127.20.244.124@KRBTEST.COM'} at 127.0.0.1:40698
I20260811 11:45:35.181561 29995 tablet_service.cc:1514] Processing DeleteTablet for tablet 528ffb6a7aca43bfbcb3c85ff73586f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:35 UTC) from {username='oryx', principal='oryx/127.20.244.124@KRBTEST.COM'} at 127.0.0.1:36666
I20260811 11:45:35.181613 30164 tablet_service.cc:1514] Processing DeleteTablet for tablet 528ffb6a7aca43bfbcb3c85ff73586f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:35 UTC) from {username='oryx', principal='oryx/127.20.244.124@KRBTEST.COM'} at 127.0.0.1:50270
I20260811 11:45:35.181885 30581 tablet_replica.cc:330] T 528ffb6a7aca43bfbcb3c85ff73586f4 P 09025679fb854a8dadd0ff0e1952e5f9: stopping tablet replica
I20260811 11:45:35.181993 30582 tablet_replica.cc:330] T 528ffb6a7aca43bfbcb3c85ff73586f4 P f902f72b2c094219b426f4a0cd80529b: stopping tablet replica
I20260811 11:45:35.182107 30582 raft_consensus.cc:2229] T 528ffb6a7aca43bfbcb3c85ff73586f4 P f902f72b2c094219b426f4a0cd80529b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:35.182108 30581 raft_consensus.cc:2229] T 528ffb6a7aca43bfbcb3c85ff73586f4 P 09025679fb854a8dadd0ff0e1952e5f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:35.182245 30582 raft_consensus.cc:2258] T 528ffb6a7aca43bfbcb3c85ff73586f4 P f902f72b2c094219b426f4a0cd80529b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:35.182358 30581 raft_consensus.cc:2258] T 528ffb6a7aca43bfbcb3c85ff73586f4 P 09025679fb854a8dadd0ff0e1952e5f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:35.182535 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 29801
I20260811 11:45:35.186844 30582 ts_tablet_manager.cc:1905] T 528ffb6a7aca43bfbcb3c85ff73586f4 P f902f72b2c094219b426f4a0cd80529b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:35.189294 30582 ts_tablet_manager.cc:1918] T 528ffb6a7aca43bfbcb3c85ff73586f4 P f902f72b2c094219b426f4a0cd80529b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:45:35.189405 30582 log.cc:1196] T 528ffb6a7aca43bfbcb3c85ff73586f4 P f902f72b2c094219b426f4a0cd80529b: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/528ffb6a7aca43bfbcb3c85ff73586f4
I20260811 11:45:35.189689 30582 ts_tablet_manager.cc:1939] T 528ffb6a7aca43bfbcb3c85ff73586f4 P f902f72b2c094219b426f4a0cd80529b: Deleting consensus metadata
I20260811 11:45:35.190479 29831 catalog_manager.cc:4841] TS f902f72b2c094219b426f4a0cd80529b (127.20.244.66:44491): tablet 528ffb6a7aca43bfbcb3c85ff73586f4 (table test-table [id=28a051970f3b4b80bd9b9217a212215b]) successfully deleted
I20260811 11:45:35.195421 30580 tablet_replica.cc:330] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598: stopping tablet replica
I20260811 11:45:35.195585 30580 raft_consensus.cc:2229] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:45:35.196003 30580 raft_consensus.cc:2258] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:35.196764 30580 ts_tablet_manager.cc:1905] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:35.199535 30580 ts_tablet_manager.cc:1918] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:45:35.199625 30580 log.cc:1196] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/528ffb6a7aca43bfbcb3c85ff73586f4
I20260811 11:45:35.199952 30580 ts_tablet_manager.cc:1939] T 528ffb6a7aca43bfbcb3c85ff73586f4 P c261356616aa44aca005f79e87745598: Deleting consensus metadata
I20260811 11:45:35.200145 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 30088
I20260811 11:45:35.203040 29829 catalog_manager.cc:4841] TS c261356616aa44aca005f79e87745598 (127.20.244.67:32783): tablet 528ffb6a7aca43bfbcb3c85ff73586f4 (table test-table [id=28a051970f3b4b80bd9b9217a212215b]) successfully deleted
I20260811 11:45:35.204738 30544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:35.204413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:45231 (local address 127.0.0.1:36680)
0811 11:45:35.204561 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:35.204635 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.65:45231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260811 11:45:35.204988 29828 catalog_manager.cc:4584] TS 09025679fb854a8dadd0ff0e1952e5f9 (127.20.244.65:45231): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 528ffb6a7aca43bfbcb3c85ff73586f4: Network error: Client connection negotiation failed: client connection to 127.20.244.65:45231: connect: Connection refused (error 111)
I20260811 11:45:35.213402 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 30258
I20260811 11:45:35.222918 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 29450
I20260811 11:45:35.234570 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 29571
2026-08-11T11:45:35Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7009 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:45:35 dist-test-slave-vkjp krb5kdc[30585](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:45:35 dist-test-slave-vkjp krb5kdc[30585](info): set up 2 sockets
Aug 11 11:45:35 dist-test-slave-vkjp krb5kdc[30585](info): commencing operation
krb5kdc: starting...
W20260811 11:45:36.373179 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:45:36 dist-test-slave-vkjp krb5kdc[30585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:45:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:45:36Z Disabled control of system clock
WARNING: no policy specified for oryx/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.126.keytab.
Entry for principal oryx/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.126.keytab.
I20260811 11:45:36.506826 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:36299
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.126.keytab
--principal=oryx/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:37481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:36299
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:36.622682 30602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:36.622992 30602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:36.623062 30602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:36.627065 30602 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:36.627175 30602 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 11:45:36.627208 30602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:36.627252 30602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:36.627297 30602 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:36.627333 30602 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:45:36.632723 30602 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:36299
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.126.keytab
--principal=oryx/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:36299
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:36.633814 30602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:36.634860 30602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:36.643684 30611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:36.643730 30602 server_base.cc:1034] running on GCE node
W20260811 11:45:36.643678 30608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:36.643678 30607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:36.644544 30602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:36.645686 30602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:36.646863 30602 hybrid_clock.cc:648] HybridClock initialized: now 1786448736646840 us; error 34 us; skew 500 ppm
Aug 11 11:45:36 dist-test-slave-vkjp krb5kdc[30585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448736, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:36.650023 30602 init.cc:377] Logged in from keytab as oryx/127.20.244.126@KRBTEST.COM (short username oryx)
I20260811 11:45:36.650997 30602 webserver.cc:460] Webserver started at http://127.20.244.126:44071/ using document root <none> and password file <none>
I20260811 11:45:36.651605 30602 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:36.651702 30602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:36.651949 30602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:36.654054 30602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "6f7360d9660b4fecb7985f08d5bccd90"
format_stamp: "Formatted at 2026-08-11 11:45:36 on dist-test-slave-vkjp"
server_key: "78b48cac62650f12bca53ba83d7bf612"
server_key_iv: "e7870512d61134b6422cc5840e1c0b4c"
server_key_version: "encryptionkey@0"
I20260811 11:45:36.654664 30602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "6f7360d9660b4fecb7985f08d5bccd90"
format_stamp: "Formatted at 2026-08-11 11:45:36 on dist-test-slave-vkjp"
server_key: "78b48cac62650f12bca53ba83d7bf612"
server_key_iv: "e7870512d61134b6422cc5840e1c0b4c"
server_key_version: "encryptionkey@0"
I20260811 11:45:36.658774 30602 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260811 11:45:36.661482 30619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:36.662919 30602 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 11:45:36.663064 30602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "6f7360d9660b4fecb7985f08d5bccd90"
format_stamp: "Formatted at 2026-08-11 11:45:36 on dist-test-slave-vkjp"
server_key: "78b48cac62650f12bca53ba83d7bf612"
server_key_iv: "e7870512d61134b6422cc5840e1c0b4c"
server_key_version: "encryptionkey@0"
I20260811 11:45:36.663233 30602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:36.682647 30602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:36.685860 30602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:36.686175 30602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:36.694485 30602 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:36299
I20260811 11:45:36.694506 30688 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:36299 every 8 connection(s)
I20260811 11:45:36.695572 30602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:45:36.698403 30689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:36.704027 30689 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90: Bootstrap starting.
I20260811 11:45:36.704420 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 30602
I20260811 11:45:36.704571 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:45:36.704875 21457 external_mini_cluster.cc:1428] Setting key 529ea686484f2538968f11821751dc38
I20260811 11:45:36.706862 30689 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:36.707682 30689 log.cc:824] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:36.709857 30689 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90: No bootstrap required, opened a new log
Aug 11 11:45:36 dist-test-slave-vkjp krb5kdc[30585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM
I20260811 11:45:36.714521 30689 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f7360d9660b4fecb7985f08d5bccd90" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 36299 } }
I20260811 11:45:36.714790 30689 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:36.714859 30689 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f7360d9660b4fecb7985f08d5bccd90, State: Initialized, Role: FOLLOWER
I20260811 11:45:36.715384 30689 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f7360d9660b4fecb7985f08d5bccd90" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 36299 } }
I20260811 11:45:36.715585 30689 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:45:36.715663 30689 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:45:36.715783 30689 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:36.717000 30689 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f7360d9660b4fecb7985f08d5bccd90" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 36299 } }
I20260811 11:45:36.717368 30689 leader_election.cc:302] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f7360d9660b4fecb7985f08d5bccd90; no voters:
I20260811 11:45:36.717741 30689 leader_election.cc:288] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:45:36.717893 30696 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:36.718111 30696 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90 [term 1 LEADER]: Becoming Leader. State: Replica: 6f7360d9660b4fecb7985f08d5bccd90, State: Running, Role: LEADER
I20260811 11:45:36.718418 30696 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f7360d9660b4fecb7985f08d5bccd90" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 36299 } }
I20260811 11:45:36.719137 30689 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:45:36.720331 30702 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f7360d9660b4fecb7985f08d5bccd90. Latest consensus state: current_term: 1 leader_uuid: "6f7360d9660b4fecb7985f08d5bccd90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f7360d9660b4fecb7985f08d5bccd90" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 36299 } } }
I20260811 11:45:36.720266 30701 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f7360d9660b4fecb7985f08d5bccd90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f7360d9660b4fecb7985f08d5bccd90" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 36299 } } }
I20260811 11:45:36.720443 30702 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:36.720443 30701 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:36.720911 30709 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:45:36.721423 30694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:36.706261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39288 (local address 127.20.244.126:36299)
0811 11:45:36.706680 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:36.706695 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:36.706732 (+ 37us) server_negotiation.cc:407] Connection header received
0811 11:45:36.707531 (+ 799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:36.707551 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:36.707929 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:36.708296 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:36.709125 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:36.710228 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:36.711443 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:36.711894 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:36.712018 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:36.714922 (+ 2904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:36.714929 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:36.714945 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:36.714978 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:36.717140 (+ 2162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:36.717623 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:36.717631 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:36.717641 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:36.717824 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:36.718186 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:36.718189 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:36.718191 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:36.718695 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:36.718893 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:36.719584 (+ 691us) server_negotiation.cc:299] Negotiation successful
0811 11:45:36.719985 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":34,"server-negotiator.queue_time_us":260,"thread_start_us":143,"threads_started":1}
I20260811 11:45:36.724359 30709 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:45:36.730060 30709 catalog_manager.cc:1347] Generated new cluster ID: ddf83aae0af94fcd9690ff5b0b91dc63
I20260811 11:45:36.730129 30709 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:45:36.741261 30709 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:45:36.742467 30709 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:45:36.748108 30709 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90: Generated new TSK 0
I20260811 11:45:36.748854 30709 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.20.244.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.244.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.244.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.65.keytab.
Entry for principal oryx/127.20.244.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.65.keytab.
I20260811 11:45:36.784087 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:36299
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.65.keytab
--principal=oryx/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:37481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:36.898020 30721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:36.898276 30721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:36.898319 30721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:36.902261 30721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:36.902313 30721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:36.902350 30721 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 11:45:36.902424 30721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:45:36.907536 30721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.65.keytab
--principal=oryx/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.244.126:36299
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:36.908565 30721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:36.909588 30721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:36.919239 30731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:36.919317 30721 server_base.cc:1034] running on GCE node
W20260811 11:45:36.919265 30729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:36.919345 30728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:36.919930 30721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:36.920681 30721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:36.921870 30721 hybrid_clock.cc:648] HybridClock initialized: now 1786448736921835 us; error 48 us; skew 500 ppm
Aug 11 11:45:36 dist-test-slave-vkjp krb5kdc[30585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448736, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:36.924626 30721 init.cc:377] Logged in from keytab as oryx/127.20.244.65@KRBTEST.COM (short username oryx)
I20260811 11:45:36.925434 30721 webserver.cc:460] Webserver started at http://127.20.244.65:36897/ using document root <none> and password file <none>
I20260811 11:45:36.925989 30721 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:36.926079 30721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:36.926308 30721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:36.928341 30721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "e8a250514fe044ba9bf099e83c275a99"
format_stamp: "Formatted at 2026-08-11 11:45:36 on dist-test-slave-vkjp"
server_key: "7a56354a3b69c2d5fe8e0f48dc8b7b5e"
server_key_iv: "bc1f83f760f3e9bf1770298a40716e69"
server_key_version: "encryptionkey@0"
I20260811 11:45:36.928916 30721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "e8a250514fe044ba9bf099e83c275a99"
format_stamp: "Formatted at 2026-08-11 11:45:36 on dist-test-slave-vkjp"
server_key: "7a56354a3b69c2d5fe8e0f48dc8b7b5e"
server_key_iv: "bc1f83f760f3e9bf1770298a40716e69"
server_key_version: "encryptionkey@0"
I20260811 11:45:36.932482 30721 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 11:45:36.934810 30740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:36.936066 30721 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:45:36.936197 30721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "e8a250514fe044ba9bf099e83c275a99"
format_stamp: "Formatted at 2026-08-11 11:45:36 on dist-test-slave-vkjp"
server_key: "7a56354a3b69c2d5fe8e0f48dc8b7b5e"
server_key_iv: "bc1f83f760f3e9bf1770298a40716e69"
server_key_version: "encryptionkey@0"
I20260811 11:45:36.936308 30721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:36.957410 30721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:36.960914 30721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:36.961141 30721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:36.962684 30721 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:36.962761 30721 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:36.962831 30721 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:36.962883 30721 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 11:45:36 dist-test-slave-vkjp krb5kdc[30585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448736, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM
I20260811 11:45:36.973932 30721 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:46039
I20260811 11:45:36.974015 30895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:46039 every 8 connection(s)
I20260811 11:45:36.974826 30721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:45:36.978616 30694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:36.963745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:42103 (local address 127.20.244.126:36299)
0811 11:45:36.963898 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:36.963902 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:36.965078 (+ 1176us) server_negotiation.cc:407] Connection header received
0811 11:45:36.966361 (+ 1283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:36.966366 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:36.966434 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:36.966542 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:36.968230 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:36.969231 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:36.970742 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:36.971018 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:36.971181 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:36.974495 (+ 3314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:36.974499 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:36.974502 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:36.974541 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:36.976409 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:36.976969 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:36.976973 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:36.976976 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:36.977067 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:36.977447 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:36.977452 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:36.977454 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:36.977659 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:36.977779 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:36.978302 (+ 523us) server_negotiation.cc:299] Negotiation successful
0811 11:45:36.978437 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 11:45:36.979523 30755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:36.964273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:36299 (local address 127.20.244.65:42103)
0811 11:45:36.964800 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:36.964864 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:36.966085 (+ 1221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:36.966828 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:36.966839 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:36.967356 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:36.968020 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:36.968041 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:36.969420 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:36.969424 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:36.970593 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:36.970604 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:36.971228 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:36.971232 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:36.971420 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:36.972088 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:36.972115 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:36.974257 (+ 2142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:36.976550 (+ 2293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:36.976556 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:36.976571 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:36.976851 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:36.977172 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:36.977176 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:36.977178 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:36.977333 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:36.977778 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:36.977785 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:36.978049 (+ 264us) client_negotiation.cc:769] Sending connection context
0811 11:45:36.978261 (+ 212us) client_negotiation.cc:240] Negotiation successful
0811 11:45:36.978609 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":135,"threads_started":1}
I20260811 11:45:36.980809 30896 heartbeater.cc:347] Connected to a master server at 127.20.244.126:36299
I20260811 11:45:36.980970 30896 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:36.981420 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 30721
I20260811 11:45:36.981559 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:45:36.981555 30896 heartbeater.cc:511] Master 127.20.244.126:36299 requested a full tablet report, sending...
I20260811 11:45:36.981942 21457 external_mini_cluster.cc:1428] Setting key 507c1f601143e8ffd4a42562f6a15174
I20260811 11:45:36.983389 30635 ts_manager.cc:194] Registered new tserver with Master: e8a250514fe044ba9bf099e83c275a99 (127.20.244.65:46039)
I20260811 11:45:36.984984 30635 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:42103
I20260811 11:45:36.992202 30694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:36.983303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:33111 (local address 127.20.244.126:36299)
0811 11:45:36.983435 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:36.983439 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:36.984043 (+ 604us) server_negotiation.cc:407] Connection header received
0811 11:45:36.984153 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:36.984159 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:36.984214 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:36.984307 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:36.984825 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:36.985662 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:36.986943 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:36.987284 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:36.987379 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:36.988732 (+ 1353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:36.988735 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:36.988737 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:36.988760 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:36.990326 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:36.990885 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:36.990888 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:36.990889 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:36.990972 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:36.991337 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:36.991340 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:36.991377 (+ 37us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:36.991563 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:36.991650 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:36.991980 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 11:45:36.992083 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 11:45:36.992318 30903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:36.983606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:36299 (local address 127.20.244.65:33111)
0811 11:45:36.983934 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:36.983950 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:36.984059 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:36.984353 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:36.984356 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:36.984583 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:36.984701 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:36.984707 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:36.985827 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:36.985832 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:36.986800 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:36.986812 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:36.987423 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:36.987429 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:36.987556 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:36.988064 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:36.988084 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:36.988565 (+ 481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:36.990489 (+ 1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:36.990496 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:36.990501 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:36.990773 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:36.991119 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:36.991123 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:36.991125 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:36.991223 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:36.991675 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:36.991679 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:36.991791 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 11:45:36.991912 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 11:45:36.992072 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":123,"threads_started":1}
WARNING: no policy specified for oryx/127.20.244.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.244.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.244.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.66.keytab.
Entry for principal oryx/127.20.244.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.66.keytab.
I20260811 11:45:37.014050 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:36299
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.66.keytab
--principal=oryx/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:37481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:37.127105 30906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:37.127350 30906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:37.127393 30906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:37.131367 30906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:37.131418 30906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:37.131456 30906 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 11:45:37.131487 30906 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:45:37.136503 30906 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.66.keytab
--principal=oryx/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.244.126:36299
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:37.137480 30906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:37.138439 30906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:37.148011 30916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:37.148023 30918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:37.148052 30915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:37.148202 30906 server_base.cc:1034] running on GCE node
I20260811 11:45:37.148659 30906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:37.149261 30906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:37.150429 30906 hybrid_clock.cc:648] HybridClock initialized: now 1786448737150410 us; error 29 us; skew 500 ppm
Aug 11 11:45:37 dist-test-slave-vkjp krb5kdc[30585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448737, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:37.153316 30906 init.cc:377] Logged in from keytab as oryx/127.20.244.66@KRBTEST.COM (short username oryx)
I20260811 11:45:37.154194 30906 webserver.cc:460] Webserver started at http://127.20.244.66:40059/ using document root <none> and password file <none>
I20260811 11:45:37.154740 30906 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:37.154827 30906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:37.155150 30906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:37.157140 30906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "cff21cb0730e495f9e43bbd3a4078be6"
format_stamp: "Formatted at 2026-08-11 11:45:37 on dist-test-slave-vkjp"
server_key: "7e46af73791bebfcce3c4d8e809ad576"
server_key_iv: "6f6d025a26a71d15f540689d17b55553"
server_key_version: "encryptionkey@0"
I20260811 11:45:37.157706 30906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "cff21cb0730e495f9e43bbd3a4078be6"
format_stamp: "Formatted at 2026-08-11 11:45:37 on dist-test-slave-vkjp"
server_key: "7e46af73791bebfcce3c4d8e809ad576"
server_key_iv: "6f6d025a26a71d15f540689d17b55553"
server_key_version: "encryptionkey@0"
I20260811 11:45:37.161401 30906 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260811 11:45:37.163725 30926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:37.164951 30906 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260811 11:45:37.165081 30906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "cff21cb0730e495f9e43bbd3a4078be6"
format_stamp: "Formatted at 2026-08-11 11:45:37 on dist-test-slave-vkjp"
server_key: "7e46af73791bebfcce3c4d8e809ad576"
server_key_iv: "6f6d025a26a71d15f540689d17b55553"
server_key_version: "encryptionkey@0"
I20260811 11:45:37.165186 30906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:37.190587 30906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:37.193899 30906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:37.194115 30906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:37.195659 30906 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:37.195730 30906 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:37.195796 30906 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:37.195858 30906 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:37.207293 30906 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:38853
I20260811 11:45:37.207376 31066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:38853 every 8 connection(s)
I20260811 11:45:37.208362 30906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
Aug 11 11:45:37 dist-test-slave-vkjp krb5kdc[30585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448737, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM
I20260811 11:45:37.211364 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 30906
I20260811 11:45:37.211509 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:45:37.211843 21457 external_mini_cluster.cc:1428] Setting key 546c85595331c1d6e41667a4aab0ff5c
I20260811 11:45:37.213697 30694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.196385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:42379 (local address 127.20.244.126:36299)
0811 11:45:37.196525 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:37.196528 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:37.197491 (+ 963us) server_negotiation.cc:407] Connection header received
0811 11:45:37.198602 (+ 1111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:37.198635 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:37.198743 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:37.198883 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:37.204239 (+ 5356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.205105 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.206539 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.206896 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.207026 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.210003 (+ 2977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:37.210007 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:37.210009 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:37.210034 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:37.211370 (+ 1336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:37.211974 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:37.211978 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:37.211980 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:37.212063 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:37.212461 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:37.212464 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:37.212466 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:37.212649 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:37.212727 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:37.213392 (+ 665us) server_negotiation.cc:299] Negotiation successful
0811 11:45:37.213543 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 11:45:37.214711 30936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.196880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:36299 (local address 127.20.244.66:42379)
0811 11:45:37.197343 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:37.197384 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:37.198334 (+ 950us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:37.202713 (+ 4379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:37.202722 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:37.203253 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:37.204057 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.204083 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.205256 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.205260 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.206403 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.206414 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.207120 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.207126 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.207407 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.208055 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:37.208071 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:37.209826 (+ 1755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:37.211530 (+ 1704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:37.211556 (+ 26us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:37.211572 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:37.211830 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:37.212164 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:37.212168 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:37.212170 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:37.212337 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:37.212778 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:37.212785 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:37.213080 (+ 295us) client_negotiation.cc:769] Sending connection context
0811 11:45:37.213348 (+ 268us) client_negotiation.cc:240] Negotiation successful
0811 11:45:37.213663 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":121,"threads_started":1}
I20260811 11:45:37.216236 31067 heartbeater.cc:347] Connected to a master server at 127.20.244.126:36299
I20260811 11:45:37.216425 31067 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:37.216917 31067 heartbeater.cc:511] Master 127.20.244.126:36299 requested a full tablet report, sending...
I20260811 11:45:37.217903 30636 ts_manager.cc:194] Registered new tserver with Master: cff21cb0730e495f9e43bbd3a4078be6 (127.20.244.66:38853)
I20260811 11:45:37.218493 30636 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:42379
WARNING: no policy specified for oryx/127.20.244.67@KRBTEST.COM; defaulting to no policy
I20260811 11:45:37.227192 30694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.218862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:57037 (local address 127.20.244.126:36299)
0811 11:45:37.219009 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:37.219015 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:37.219492 (+ 477us) server_negotiation.cc:407] Connection header received
0811 11:45:37.219619 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:37.219623 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:37.219700 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:37.219802 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:37.220634 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.221320 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.222212 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.222457 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.222579 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.223839 (+ 1260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:37.223843 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:37.223846 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:37.223880 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:37.225433 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:37.225886 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:37.225889 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:37.225891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:37.225978 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:37.226290 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:37.226294 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:37.226295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:37.226515 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:37.226629 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:37.226895 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 11:45:37.227008 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 11:45:37.227200 31075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.218946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:36299 (local address 127.20.244.66:57037)
0811 11:45:37.219400 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:37.219414 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:37.219535 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:37.219949 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:37.219952 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:37.220248 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:37.220443 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.220454 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.221480 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.221484 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.222077 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.222086 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.222582 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.222587 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.222689 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.223326 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:37.223340 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:37.223671 (+ 331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:37.225561 (+ 1890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:37.225565 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:37.225574 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:37.225775 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:37.226079 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:37.226083 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:37.226084 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:37.226175 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:37.226619 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:37.226622 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:37.226725 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 11:45:37.226837 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 11:45:37.226976 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":117,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.244.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.244.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.67.keytab.
Entry for principal oryx/127.20.244.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.67.keytab.
I20260811 11:45:37.244566 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:36299
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.67.keytab
--principal=oryx/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:37481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:37.355818 31077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:37.356117 31077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:37.356194 31077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:37.360174 31077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:37.360258 31077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:37.360327 31077 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 11:45:37.360404 31077 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:45:37.365499 31077 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.67.keytab
--principal=oryx/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.244.126:36299
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:37.366544 31077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:37.367597 31077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:37.377127 31082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:37.377202 31077 server_base.cc:1034] running on GCE node
W20260811 11:45:37.377146 31083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:37.377127 31085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:37.377841 31077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:37.378517 31077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:37.379710 31077 hybrid_clock.cc:648] HybridClock initialized: now 1786448737379691 us; error 35 us; skew 500 ppm
Aug 11 11:45:37 dist-test-slave-vkjp krb5kdc[30585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448737, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:37.382691 31077 init.cc:377] Logged in from keytab as oryx/127.20.244.67@KRBTEST.COM (short username oryx)
I20260811 11:45:37.383592 31077 webserver.cc:460] Webserver started at http://127.20.244.67:40611/ using document root <none> and password file <none>
I20260811 11:45:37.384145 31077 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:37.384204 31077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:37.384439 31077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:37.386497 31077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "07349c4d8c124d50b4ce4a4944e66c0b"
format_stamp: "Formatted at 2026-08-11 11:45:37 on dist-test-slave-vkjp"
server_key: "b5261a774cca132a1c9a1a9797604879"
server_key_iv: "3c3d617fc2ee3c901d95cfb08bbcb37c"
server_key_version: "encryptionkey@0"
I20260811 11:45:37.387058 31077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "07349c4d8c124d50b4ce4a4944e66c0b"
format_stamp: "Formatted at 2026-08-11 11:45:37 on dist-test-slave-vkjp"
server_key: "b5261a774cca132a1c9a1a9797604879"
server_key_iv: "3c3d617fc2ee3c901d95cfb08bbcb37c"
server_key_version: "encryptionkey@0"
I20260811 11:45:37.390903 31077 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 11:45:37.393278 31093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:37.394421 31077 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:37.394546 31077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "07349c4d8c124d50b4ce4a4944e66c0b"
format_stamp: "Formatted at 2026-08-11 11:45:37 on dist-test-slave-vkjp"
server_key: "b5261a774cca132a1c9a1a9797604879"
server_key_iv: "3c3d617fc2ee3c901d95cfb08bbcb37c"
server_key_version: "encryptionkey@0"
I20260811 11:45:37.394652 31077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:37.408802 31077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:37.411552 31077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:37.411757 31077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:37.413160 31077 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:37.413208 31077 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:37.413245 31077 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:37.413260 31077 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 11:45:37 dist-test-slave-vkjp krb5kdc[30585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448737, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM
I20260811 11:45:37.424696 31077 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:43989
I20260811 11:45:37.425882 31077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:45:37.426818 31241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:43989 every 8 connection(s)
I20260811 11:45:37.428741 30694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.414369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:59789 (local address 127.20.244.126:36299)
0811 11:45:37.414542 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:37.414548 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:37.415463 (+ 915us) server_negotiation.cc:407] Connection header received
0811 11:45:37.416826 (+ 1363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:37.416833 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:37.416902 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:37.417010 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:37.418305 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.419246 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.421280 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.421666 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.421778 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.424729 (+ 2951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:37.424735 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:37.424740 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:37.424771 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:37.426374 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:37.427029 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:37.427032 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:37.427034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:37.427194 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:37.427640 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:37.427644 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:37.427646 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:37.427846 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:37.427967 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:37.428445 (+ 478us) server_negotiation.cc:299] Negotiation successful
0811 11:45:37.428571 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 11:45:37.429468 31103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.414757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:36299 (local address 127.20.244.67:59789)
0811 11:45:37.415299 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:37.415355 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:37.416566 (+ 1211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:37.417256 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:37.417264 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:37.417612 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:37.418104 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.418126 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.419430 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.419437 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.421113 (+ 1676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.421128 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.421865 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.421871 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.422079 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.422748 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:37.422767 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:37.424509 (+ 1742us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:37.426506 (+ 1997us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:37.426513 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:37.426528 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:37.426905 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:37.427360 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:37.427365 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:37.427370 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:37.427554 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:37.427966 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:37.427973 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:37.428205 (+ 232us) client_negotiation.cc:769] Sending connection context
0811 11:45:37.428397 (+ 192us) client_negotiation.cc:240] Negotiation successful
0811 11:45:37.428694 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":151,"threads_started":1}
I20260811 11:45:37.430562 31242 heartbeater.cc:347] Connected to a master server at 127.20.244.126:36299
I20260811 11:45:37.430697 31242 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:37.431259 31242 heartbeater.cc:511] Master 127.20.244.126:36299 requested a full tablet report, sending...
I20260811 11:45:37.431807 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 31077
I20260811 11:45:37.431959 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:45:37.432361 21457 external_mini_cluster.cc:1428] Setting key 9f0c305d66e0390036b030bdbd4a6253
I20260811 11:45:37.432525 30635 ts_manager.cc:194] Registered new tserver with Master: 07349c4d8c124d50b4ce4a4944e66c0b (127.20.244.67:43989)
I20260811 11:45:37.433290 30635 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:59789
I20260811 11:45:37.434631 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:45:37.442529 30694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.433084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:53099 (local address 127.20.244.126:36299)
0811 11:45:37.433181 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:37.433184 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:37.433788 (+ 604us) server_negotiation.cc:407] Connection header received
0811 11:45:37.433879 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:37.433882 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:37.433934 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:37.433979 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:37.435709 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.436507 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.437571 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.437777 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.437863 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.439036 (+ 1173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:37.439040 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:37.439045 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:37.439072 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:37.440921 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:37.441361 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:37.441365 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:37.441367 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:37.441451 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:37.441723 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:37.441727 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:37.441729 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:37.441907 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:37.442012 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:37.442268 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 11:45:37.442374 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 11:45:37.442543 31250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.432885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:36299 (local address 127.20.244.67:53099)
0811 11:45:37.433685 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:37.433701 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:37.433797 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:37.435331 (+ 1534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:37.435333 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:37.435504 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:37.435589 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.435595 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.436635 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.436638 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.437435 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.437456 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.437899 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.437903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.438007 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.438558 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:37.438570 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:37.438897 (+ 327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:37.441049 (+ 2152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:37.441054 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:37.441057 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:37.441250 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:37.441542 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:37.441545 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:37.441547 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:37.441629 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:37.442005 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:37.442008 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:37.442101 (+ 93us) client_negotiation.cc:769] Sending connection context
0811 11:45:37.442210 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 11:45:37.442360 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":713,"thread_start_us":119,"threads_started":1}
Aug 11 11:45:37 dist-test-slave-vkjp krb5kdc[30585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448737, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 11:45:37 dist-test-slave-vkjp krb5kdc[30585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:37 dist-test-slave-vkjp krb5kdc[30585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 11:45:37.461261 30694 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:37.455177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39294 (local address 127.20.244.126:36299)
0811 11:45:37.455332 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:37.455335 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:37.455349 (+ 14us) server_negotiation.cc:407] Connection header received
0811 11:45:37.455390 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:37.455392 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:37.455427 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:37.455537 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:37.456267 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.456782 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.457660 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.457975 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.458079 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.461114 (+ 3035us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39294: BlockingRecv error: recv got EOF from 127.0.0.1:39294 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 11 11:45:37 dist-test-slave-vkjp krb5kdc[30585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448737, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM
I20260811 11:45:37.470191 30694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.462630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39308 (local address 127.20.244.126:36299)
0811 11:45:37.462763 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:37.462766 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:37.462903 (+ 137us) server_negotiation.cc:407] Connection header received
0811 11:45:37.462995 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:37.462997 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:37.463032 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:37.463152 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:37.463674 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.464185 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.464905 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.465101 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.465178 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.467347 (+ 2169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:37.467350 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:37.467352 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:37.467373 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:37.468708 (+ 1335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:37.469080 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:37.469082 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:37.469083 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:37.469153 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:37.469447 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:37.469449 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:37.469450 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:37.469605 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:37.469705 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:37.469910 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 11:45:37.469996 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 11:45:37.473037 30635 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39308:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:45:37.476011 30635 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:45:37.490557 31270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.484680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47568 (local address 127.20.244.65:46039)
0811 11:45:37.485514 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:37.485520 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:37.485546 (+ 26us) server_negotiation.cc:407] Connection header received
0811 11:45:37.485626 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:37.485632 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:37.485833 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:37.485994 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:37.486381 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.487589 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.489083 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.489884 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.490009 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.490160 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:37.490304 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 11:45:37.490409 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":724,"thread_start_us":89,"threads_started":1}
I20260811 11:45:37.490566 31268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.484414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:43989 (local address 127.0.0.1:37018)
0811 11:45:37.484812 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:37.484856 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:37.484993 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:37.486006 (+ 1013us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:37.486012 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:37.486034 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:37.486165 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.486172 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.487726 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.487730 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.489213 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.489223 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.490228 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.490235 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.490331 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.490352 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 11:45:37.490410 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 11:45:37.490464 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"mutex_wait_us":143,"thread_start_us":71,"threads_started":1}
I20260811 11:45:37.490564 31269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.484515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:46039 (local address 127.0.0.1:47568)
0811 11:45:37.485166 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:37.485179 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:37.485273 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:37.486142 (+ 869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:37.486145 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:37.486158 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:37.486263 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.486269 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.487726 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.487730 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.488930 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.488955 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.490009 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.490012 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.490100 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.490132 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 11:45:37.490259 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 11:45:37.490403 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"mutex_wait_us":132,"thread_start_us":111,"threads_started":1}
I20260811 11:45:37.491202 31273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.485182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37018 (local address 127.20.244.67:43989)
0811 11:45:37.485595 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:37.485606 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:37.485624 (+ 18us) server_negotiation.cc:407] Connection header received
0811 11:45:37.485686 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:37.485690 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:37.485832 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:37.486322 (+ 490us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:37.486465 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.487589 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.489343 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.490106 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.490213 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.490390 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:37.490436 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 11:45:37.490521 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":108,"threads_started":1}
I20260811 11:45:37.492578 31271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.485181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:38853 (local address 127.0.0.1:43376)
0811 11:45:37.485949 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:37.485962 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:37.486055 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:37.486587 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:37.486590 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:37.486609 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:37.486697 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.486705 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.487705 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.487711 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.489212 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.489223 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.492172 (+ 2949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.492175 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.492263 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.492286 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 11:45:37.492366 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 11:45:37.492437 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":676,"mutex_wait_us":84,"thread_start_us":90,"threads_started":1}
I20260811 11:45:37.492662 31274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.485393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43376 (local address 127.20.244.66:38853)
0811 11:45:37.485717 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:37.485729 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:37.486156 (+ 427us) server_negotiation.cc:407] Connection header received
0811 11:45:37.486242 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:37.486251 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:37.486438 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:37.486610 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:37.486793 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.487591 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.490849 (+ 3258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.491822 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.491945 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.492106 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:37.492427 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 11:45:37.492525 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":129,"threads_started":1}
I20260811 11:45:37.493678 31156 tablet_service.cc:1467] Processing CreateTablet for tablet f0e28eeb00ba4f2c97212abf8c77e585 (DEFAULT_TABLE table=test-table [id=b573a771dee64f9b9a593f38a54b0044]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:37.493656 30809 tablet_service.cc:1467] Processing CreateTablet for tablet f0e28eeb00ba4f2c97212abf8c77e585 (DEFAULT_TABLE table=test-table [id=b573a771dee64f9b9a593f38a54b0044]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:37.494539 30809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0e28eeb00ba4f2c97212abf8c77e585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:37.494568 31156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0e28eeb00ba4f2c97212abf8c77e585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:37.498252 30986 tablet_service.cc:1467] Processing CreateTablet for tablet f0e28eeb00ba4f2c97212abf8c77e585 (DEFAULT_TABLE table=test-table [id=b573a771dee64f9b9a593f38a54b0044]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:37.499456 30986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0e28eeb00ba4f2c97212abf8c77e585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:37.501587 31275 tablet_bootstrap.cc:492] T f0e28eeb00ba4f2c97212abf8c77e585 P 07349c4d8c124d50b4ce4a4944e66c0b: Bootstrap starting.
I20260811 11:45:37.502230 31277 tablet_bootstrap.cc:492] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99: Bootstrap starting.
I20260811 11:45:37.504304 31275 tablet_bootstrap.cc:654] T f0e28eeb00ba4f2c97212abf8c77e585 P 07349c4d8c124d50b4ce4a4944e66c0b: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:37.504519 31277 tablet_bootstrap.cc:654] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:37.505321 31275 log.cc:824] T f0e28eeb00ba4f2c97212abf8c77e585 P 07349c4d8c124d50b4ce4a4944e66c0b: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:37.505342 31277 log.cc:824] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:37.507296 31275 tablet_bootstrap.cc:492] T f0e28eeb00ba4f2c97212abf8c77e585 P 07349c4d8c124d50b4ce4a4944e66c0b: No bootstrap required, opened a new log
I20260811 11:45:37.507436 31277 tablet_bootstrap.cc:492] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99: No bootstrap required, opened a new log
I20260811 11:45:37.507503 31275 ts_tablet_manager.cc:1397] T f0e28eeb00ba4f2c97212abf8c77e585 P 07349c4d8c124d50b4ce4a4944e66c0b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 11:45:37.507542 31281 tablet_bootstrap.cc:492] T f0e28eeb00ba4f2c97212abf8c77e585 P cff21cb0730e495f9e43bbd3a4078be6: Bootstrap starting.
I20260811 11:45:37.507617 31277 ts_tablet_manager.cc:1397] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260811 11:45:37.509802 31281 tablet_bootstrap.cc:654] T f0e28eeb00ba4f2c97212abf8c77e585 P cff21cb0730e495f9e43bbd3a4078be6: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:37.510841 31281 log.cc:824] T f0e28eeb00ba4f2c97212abf8c77e585 P cff21cb0730e495f9e43bbd3a4078be6: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:37.511008 31277 raft_consensus.cc:348] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } } peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } }
I20260811 11:45:37.511341 31277 raft_consensus.cc:374] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:37.511415 31277 raft_consensus.cc:729] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8a250514fe044ba9bf099e83c275a99, State: Initialized, Role: FOLLOWER
I20260811 11:45:37.511456 31275 raft_consensus.cc:348] T f0e28eeb00ba4f2c97212abf8c77e585 P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } } peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } }
I20260811 11:45:37.511700 31275 raft_consensus.cc:374] T f0e28eeb00ba4f2c97212abf8c77e585 P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:37.511767 31275 raft_consensus.cc:729] T f0e28eeb00ba4f2c97212abf8c77e585 P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07349c4d8c124d50b4ce4a4944e66c0b, State: Initialized, Role: FOLLOWER
I20260811 11:45:37.511885 31277 consensus_queue.cc:260] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } } peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } }
I20260811 11:45:37.512166 31275 consensus_queue.cc:260] T f0e28eeb00ba4f2c97212abf8c77e585 P 07349c4d8c124d50b4ce4a4944e66c0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } } peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } }
I20260811 11:45:37.512567 30896 heartbeater.cc:503] Master 127.20.244.126:36299 was elected leader, sending a full tablet report...
I20260811 11:45:37.512882 31277 ts_tablet_manager.cc:1428] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 11:45:37.513031 31281 tablet_bootstrap.cc:492] T f0e28eeb00ba4f2c97212abf8c77e585 P cff21cb0730e495f9e43bbd3a4078be6: No bootstrap required, opened a new log
I20260811 11:45:37.513083 31275 ts_tablet_manager.cc:1428] T f0e28eeb00ba4f2c97212abf8c77e585 P 07349c4d8c124d50b4ce4a4944e66c0b: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 11:45:37.513198 31281 ts_tablet_manager.cc:1397] T f0e28eeb00ba4f2c97212abf8c77e585 P cff21cb0730e495f9e43bbd3a4078be6: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 11:45:37.513423 31242 heartbeater.cc:503] Master 127.20.244.126:36299 was elected leader, sending a full tablet report...
I20260811 11:45:37.516860 31281 raft_consensus.cc:348] T f0e28eeb00ba4f2c97212abf8c77e585 P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } } peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } }
I20260811 11:45:37.517282 31281 raft_consensus.cc:374] T f0e28eeb00ba4f2c97212abf8c77e585 P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:37.517336 31281 raft_consensus.cc:729] T f0e28eeb00ba4f2c97212abf8c77e585 P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cff21cb0730e495f9e43bbd3a4078be6, State: Initialized, Role: FOLLOWER
I20260811 11:45:37.517781 31281 consensus_queue.cc:260] T f0e28eeb00ba4f2c97212abf8c77e585 P cff21cb0730e495f9e43bbd3a4078be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } } peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } }
I20260811 11:45:37.518409 31067 heartbeater.cc:503] Master 127.20.244.126:36299 was elected leader, sending a full tablet report...
I20260811 11:45:37.518687 31281 ts_tablet_manager.cc:1428] T f0e28eeb00ba4f2c97212abf8c77e585 P cff21cb0730e495f9e43bbd3a4078be6: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 11:45:37.609375 31285 raft_consensus.cc:482] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:45:37.609580 31285 raft_consensus.cc:504] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } } peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } }
I20260811 11:45:37.610692 31285 leader_election.cc:288] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07349c4d8c124d50b4ce4a4944e66c0b (127.20.244.67:43989), cff21cb0730e495f9e43bbd3a4078be6 (127.20.244.66:38853)
I20260811 11:45:37.614804 31274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.611073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:44861 (local address 127.20.244.66:38853)
0811 11:45:37.611404 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:37.611409 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:37.611526 (+ 117us) server_negotiation.cc:407] Connection header received
0811 11:45:37.611662 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:37.611665 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:37.611735 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:37.611809 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:37.612129 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.612618 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.613796 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.614195 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.614314 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.614368 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:37.614600 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 11:45:37.614670 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 11:45:37.614811 31273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.611038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:40307 (local address 127.20.244.67:43989)
0811 11:45:37.611212 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:37.611219 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:37.611404 (+ 185us) server_negotiation.cc:407] Connection header received
0811 11:45:37.611561 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:37.611564 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:37.611622 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:37.611696 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:37.612052 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.612615 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.613817 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.614211 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.614344 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.614395 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:37.614633 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 11:45:37.614705 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 11:45:37.614835 31288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.610927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:43989 (local address 127.20.244.65:40307)
0811 11:45:37.611296 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:37.611314 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:37.611435 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:37.611722 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:37.611726 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:37.611741 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:37.611922 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.611929 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.612732 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.612737 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.613674 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.613683 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.614349 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.614352 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.614491 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.614509 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 11:45:37.614601 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 11:45:37.614671 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"mutex_wait_us":103,"thread_start_us":149,"threads_started":1}
I20260811 11:45:37.614840 31291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.610959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:38853 (local address 127.20.244.65:44861)
0811 11:45:37.611420 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:37.611434 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:37.611563 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:37.611843 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:37.611845 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:37.611859 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:37.612014 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.612020 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.612737 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.612740 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.613668 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.613677 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.614323 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.614327 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.614445 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.614492 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 11:45:37.614553 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 11:45:37.614646 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"mutex_wait_us":100,"thread_start_us":144,"threads_started":1}
I20260811 11:45:37.615501 31182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0e28eeb00ba4f2c97212abf8c77e585" candidate_uuid: "e8a250514fe044ba9bf099e83c275a99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" is_pre_election: true
I20260811 11:45:37.615692 31007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0e28eeb00ba4f2c97212abf8c77e585" candidate_uuid: "e8a250514fe044ba9bf099e83c275a99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cff21cb0730e495f9e43bbd3a4078be6" is_pre_election: true
I20260811 11:45:37.615857 31182 raft_consensus.cc:2454] T f0e28eeb00ba4f2c97212abf8c77e585 P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a250514fe044ba9bf099e83c275a99 in term 0.
I20260811 11:45:37.616026 31007 raft_consensus.cc:2454] T f0e28eeb00ba4f2c97212abf8c77e585 P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a250514fe044ba9bf099e83c275a99 in term 0.
I20260811 11:45:37.616410 30745 leader_election.cc:302] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07349c4d8c124d50b4ce4a4944e66c0b, e8a250514fe044ba9bf099e83c275a99; no voters:
I20260811 11:45:37.616680 31285 raft_consensus.cc:2781] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:45:37.616770 31285 raft_consensus.cc:482] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:45:37.616817 31285 raft_consensus.cc:3037] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:37.617878 31285 raft_consensus.cc:504] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } } peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } }
I20260811 11:45:37.618232 31285 leader_election.cc:288] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99 [CANDIDATE]: Term 1 election: Requested vote from peers 07349c4d8c124d50b4ce4a4944e66c0b (127.20.244.67:43989), cff21cb0730e495f9e43bbd3a4078be6 (127.20.244.66:38853)
I20260811 11:45:37.618557 31182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0e28eeb00ba4f2c97212abf8c77e585" candidate_uuid: "e8a250514fe044ba9bf099e83c275a99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07349c4d8c124d50b4ce4a4944e66c0b"
I20260811 11:45:37.618610 31007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0e28eeb00ba4f2c97212abf8c77e585" candidate_uuid: "e8a250514fe044ba9bf099e83c275a99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cff21cb0730e495f9e43bbd3a4078be6"
I20260811 11:45:37.618714 31182 raft_consensus.cc:3037] T f0e28eeb00ba4f2c97212abf8c77e585 P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:37.618739 31007 raft_consensus.cc:3037] T f0e28eeb00ba4f2c97212abf8c77e585 P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:37.620177 31007 raft_consensus.cc:2454] T f0e28eeb00ba4f2c97212abf8c77e585 P cff21cb0730e495f9e43bbd3a4078be6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a250514fe044ba9bf099e83c275a99 in term 1.
I20260811 11:45:37.620416 31182 raft_consensus.cc:2454] T f0e28eeb00ba4f2c97212abf8c77e585 P 07349c4d8c124d50b4ce4a4944e66c0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a250514fe044ba9bf099e83c275a99 in term 1.
I20260811 11:45:37.620533 30742 leader_election.cc:302] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cff21cb0730e495f9e43bbd3a4078be6, e8a250514fe044ba9bf099e83c275a99; no voters:
I20260811 11:45:37.620728 31285 raft_consensus.cc:2781] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:37.620998 31285 raft_consensus.cc:686] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99 [term 1 LEADER]: Becoming Leader. State: Replica: e8a250514fe044ba9bf099e83c275a99, State: Running, Role: LEADER
I20260811 11:45:37.621383 31285 consensus_queue.cc:237] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } } peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } }
I20260811 11:45:37.624534 30634 catalog_manager.cc:5495] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8a250514fe044ba9bf099e83c275a99 (127.20.244.65). New cstate: current_term: 1 leader_uuid: "e8a250514fe044ba9bf099e83c275a99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } health_report { overall_health: UNKNOWN } } }
I20260811 11:45:37.645574 31270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.642097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47580 (local address 127.20.244.65:46039)
0811 11:45:37.642245 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:37.642248 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:37.642259 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:45:37.642330 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:37.642332 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:37.642382 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:37.642498 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:45:37.642736 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.643288 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.644138 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.644358 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.644464 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.644748 (+ 284us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:45:37.645177 (+ 429us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:45:37.645301 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:37.645372 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 11:45:37.645431 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 11:45:37.651549 31007 raft_consensus.cc:1261] T f0e28eeb00ba4f2c97212abf8c77e585 P cff21cb0730e495f9e43bbd3a4078be6 [term 1 FOLLOWER]: Refusing update from remote peer e8a250514fe044ba9bf099e83c275a99: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:37.651573 31182 raft_consensus.cc:1261] T f0e28eeb00ba4f2c97212abf8c77e585 P 07349c4d8c124d50b4ce4a4944e66c0b [term 1 FOLLOWER]: Refusing update from remote peer e8a250514fe044ba9bf099e83c275a99: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:37.652238 31285 consensus_queue.cc:1035] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:37.652490 31292 consensus_queue.cc:1035] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:37.660472 31296 mvcc.cc:205] Tried to move back new op lower bound from 7317294029413335040 to 7317294029300191232. Current Snapshot: MvccSnapshot[applied={T|T < 7317294029413335040}]
I20260811 11:45:37.660934 31297 mvcc.cc:205] Tried to move back new op lower bound from 7317294029413335040 to 7317294029300191232. Current Snapshot: MvccSnapshot[applied={T|T < 7317294029413335040}]
I20260811 11:45:37.663844 31298 mvcc.cc:205] Tried to move back new op lower bound from 7317294029413335040 to 7317294029300191232. Current Snapshot: MvccSnapshot[applied={T|T < 7317294029413335040}]
I20260811 11:45:37.669358 30634 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:37.669503 30634 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:37.671954 30634 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90: Sending DeleteTablet for 3 replicas of tablet f0e28eeb00ba4f2c97212abf8c77e585
I20260811 11:45:37.672746 30809 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e28eeb00ba4f2c97212abf8c77e585 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:37 UTC) from {username='oryx', principal='oryx/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:47568
I20260811 11:45:37.673048 31156 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e28eeb00ba4f2c97212abf8c77e585 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:37 UTC) from {username='oryx', principal='oryx/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:37018
I20260811 11:45:37.673362 31309 tablet_replica.cc:330] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99: stopping tablet replica
I20260811 11:45:37.673358 30986 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e28eeb00ba4f2c97212abf8c77e585 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:37 UTC) from {username='oryx', principal='oryx/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:43376
I20260811 11:45:37.673779 31311 tablet_replica.cc:330] T f0e28eeb00ba4f2c97212abf8c77e585 P cff21cb0730e495f9e43bbd3a4078be6: stopping tablet replica
I20260811 11:45:37.673753 30634 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39308:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 11:45:37.673800 31309 raft_consensus.cc:2229] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:45:37.674048 31311 raft_consensus.cc:2229] T f0e28eeb00ba4f2c97212abf8c77e585 P cff21cb0730e495f9e43bbd3a4078be6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260811 11:45:37.674170 30634 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:45:37.674361 31311 raft_consensus.cc:2258] T f0e28eeb00ba4f2c97212abf8c77e585 P cff21cb0730e495f9e43bbd3a4078be6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:37.674563 31309 raft_consensus.cc:2258] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:37.675973 31311 ts_tablet_manager.cc:1905] T f0e28eeb00ba4f2c97212abf8c77e585 P cff21cb0730e495f9e43bbd3a4078be6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:37.676011 31309 ts_tablet_manager.cc:1905] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:37.678821 31311 ts_tablet_manager.cc:1918] T f0e28eeb00ba4f2c97212abf8c77e585 P cff21cb0730e495f9e43bbd3a4078be6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:45:37.678930 31311 log.cc:1196] T f0e28eeb00ba4f2c97212abf8c77e585 P cff21cb0730e495f9e43bbd3a4078be6: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/f0e28eeb00ba4f2c97212abf8c77e585
I20260811 11:45:37.679163 31309 ts_tablet_manager.cc:1918] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:45:37.679313 31311 ts_tablet_manager.cc:1939] T f0e28eeb00ba4f2c97212abf8c77e585 P cff21cb0730e495f9e43bbd3a4078be6: Deleting consensus metadata
I20260811 11:45:37.679339 31309 log.cc:1196] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-0/wal/wals/f0e28eeb00ba4f2c97212abf8c77e585
I20260811 11:45:37.679936 31309 ts_tablet_manager.cc:1939] T f0e28eeb00ba4f2c97212abf8c77e585 P e8a250514fe044ba9bf099e83c275a99: Deleting consensus metadata
I20260811 11:45:37.680332 30809 tablet_service.cc:1467] Processing CreateTablet for tablet 6c2f43a3fb904c378db9b936b41473eb (DEFAULT_TABLE table=test-table [id=a0911bbe6de44206ad45916562cb1b49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:37.680625 30809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c2f43a3fb904c378db9b936b41473eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:37.681205 30620 catalog_manager.cc:4841] TS e8a250514fe044ba9bf099e83c275a99 (127.20.244.65:46039): tablet f0e28eeb00ba4f2c97212abf8c77e585 (table test-table [id=b573a771dee64f9b9a593f38a54b0044]) successfully deleted
I20260811 11:45:37.682747 31277 tablet_bootstrap.cc:492] T 6c2f43a3fb904c378db9b936b41473eb P e8a250514fe044ba9bf099e83c275a99: Bootstrap starting.
I20260811 11:45:37.682978 30986 tablet_service.cc:1467] Processing CreateTablet for tablet 6c2f43a3fb904c378db9b936b41473eb (DEFAULT_TABLE table=test-table [id=a0911bbe6de44206ad45916562cb1b49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:37.683269 30986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c2f43a3fb904c378db9b936b41473eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:37.683727 31277 tablet_bootstrap.cc:654] T 6c2f43a3fb904c378db9b936b41473eb P e8a250514fe044ba9bf099e83c275a99: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:37.684983 31277 tablet_bootstrap.cc:492] T 6c2f43a3fb904c378db9b936b41473eb P e8a250514fe044ba9bf099e83c275a99: No bootstrap required, opened a new log
I20260811 11:45:37.685068 31277 ts_tablet_manager.cc:1397] T 6c2f43a3fb904c378db9b936b41473eb P e8a250514fe044ba9bf099e83c275a99: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:37.685252 31281 tablet_bootstrap.cc:492] T 6c2f43a3fb904c378db9b936b41473eb P cff21cb0730e495f9e43bbd3a4078be6: Bootstrap starting.
I20260811 11:45:37.685508 31277 raft_consensus.cc:348] T 6c2f43a3fb904c378db9b936b41473eb P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:37.685624 31277 raft_consensus.cc:374] T 6c2f43a3fb904c378db9b936b41473eb P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:37.685655 31277 raft_consensus.cc:729] T 6c2f43a3fb904c378db9b936b41473eb P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8a250514fe044ba9bf099e83c275a99, State: Initialized, Role: FOLLOWER
I20260811 11:45:37.685770 31277 consensus_queue.cc:260] T 6c2f43a3fb904c378db9b936b41473eb P e8a250514fe044ba9bf099e83c275a99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:37.686013 31277 ts_tablet_manager.cc:1428] T 6c2f43a3fb904c378db9b936b41473eb P e8a250514fe044ba9bf099e83c275a99: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:37.686174 31281 tablet_bootstrap.cc:654] T 6c2f43a3fb904c378db9b936b41473eb P cff21cb0730e495f9e43bbd3a4078be6: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:37.687259 31156 tablet_service.cc:1467] Processing CreateTablet for tablet 6c2f43a3fb904c378db9b936b41473eb (DEFAULT_TABLE table=test-table [id=a0911bbe6de44206ad45916562cb1b49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:37.687450 31281 tablet_bootstrap.cc:492] T 6c2f43a3fb904c378db9b936b41473eb P cff21cb0730e495f9e43bbd3a4078be6: No bootstrap required, opened a new log
I20260811 11:45:37.687521 31281 ts_tablet_manager.cc:1397] T 6c2f43a3fb904c378db9b936b41473eb P cff21cb0730e495f9e43bbd3a4078be6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 11:45:37.687573 31156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c2f43a3fb904c378db9b936b41473eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:37.687960 30620 catalog_manager.cc:4841] TS cff21cb0730e495f9e43bbd3a4078be6 (127.20.244.66:38853): tablet f0e28eeb00ba4f2c97212abf8c77e585 (table test-table [id=b573a771dee64f9b9a593f38a54b0044]) successfully deleted
I20260811 11:45:37.687933 31281 raft_consensus.cc:348] T 6c2f43a3fb904c378db9b936b41473eb P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:37.688035 31281 raft_consensus.cc:374] T 6c2f43a3fb904c378db9b936b41473eb P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:37.688064 31281 raft_consensus.cc:729] T 6c2f43a3fb904c378db9b936b41473eb P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cff21cb0730e495f9e43bbd3a4078be6, State: Initialized, Role: FOLLOWER
I20260811 11:45:37.688174 31281 consensus_queue.cc:260] T 6c2f43a3fb904c378db9b936b41473eb P cff21cb0730e495f9e43bbd3a4078be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:37.688416 31281 ts_tablet_manager.cc:1428] T 6c2f43a3fb904c378db9b936b41473eb P cff21cb0730e495f9e43bbd3a4078be6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 11:45:37.689299 31310 tablet_replica.cc:330] T f0e28eeb00ba4f2c97212abf8c77e585 P 07349c4d8c124d50b4ce4a4944e66c0b: stopping tablet replica
I20260811 11:45:37.689886 31310 raft_consensus.cc:2229] T f0e28eeb00ba4f2c97212abf8c77e585 P 07349c4d8c124d50b4ce4a4944e66c0b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:37.690228 31310 raft_consensus.cc:2258] T f0e28eeb00ba4f2c97212abf8c77e585 P 07349c4d8c124d50b4ce4a4944e66c0b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:37.690721 31275 tablet_bootstrap.cc:492] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b: Bootstrap starting.
I20260811 11:45:37.691754 31275 tablet_bootstrap.cc:654] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:37.692960 31275 tablet_bootstrap.cc:492] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b: No bootstrap required, opened a new log
I20260811 11:45:37.693035 31275 ts_tablet_manager.cc:1397] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:37.693486 31310 ts_tablet_manager.cc:1905] T f0e28eeb00ba4f2c97212abf8c77e585 P 07349c4d8c124d50b4ce4a4944e66c0b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:37.693423 31275 raft_consensus.cc:348] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:37.693539 31275 raft_consensus.cc:374] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:37.693570 31275 raft_consensus.cc:729] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07349c4d8c124d50b4ce4a4944e66c0b, State: Initialized, Role: FOLLOWER
I20260811 11:45:37.693678 31275 consensus_queue.cc:260] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:37.693924 31275 ts_tablet_manager.cc:1428] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:37.696328 31310 ts_tablet_manager.cc:1918] T f0e28eeb00ba4f2c97212abf8c77e585 P 07349c4d8c124d50b4ce4a4944e66c0b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:45:37.696422 31310 log.cc:1196] T f0e28eeb00ba4f2c97212abf8c77e585 P 07349c4d8c124d50b4ce4a4944e66c0b: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/f0e28eeb00ba4f2c97212abf8c77e585
I20260811 11:45:37.696743 31310 ts_tablet_manager.cc:1939] T f0e28eeb00ba4f2c97212abf8c77e585 P 07349c4d8c124d50b4ce4a4944e66c0b: Deleting consensus metadata
I20260811 11:45:37.697924 30622 catalog_manager.cc:4841] TS 07349c4d8c124d50b4ce4a4944e66c0b (127.20.244.67:43989): tablet f0e28eeb00ba4f2c97212abf8c77e585 (table test-table [id=b573a771dee64f9b9a593f38a54b0044]) successfully deleted
W20260811 11:45:37.709591 31068 tablet.cc:2369] T 6c2f43a3fb904c378db9b936b41473eb P cff21cb0730e495f9e43bbd3a4078be6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:45:37.726154 30898 tablet.cc:2369] T 6c2f43a3fb904c378db9b936b41473eb P e8a250514fe044ba9bf099e83c275a99: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:45:37.731693 31286 raft_consensus.cc:482] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:45:37.731814 31286 raft_consensus.cc:504] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:37.732932 31286 leader_election.cc:288] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8a250514fe044ba9bf099e83c275a99 (127.20.244.65:46039), cff21cb0730e495f9e43bbd3a4078be6 (127.20.244.66:38853)
I20260811 11:45:37.737479 31274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.733631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:53219 (local address 127.20.244.66:38853)
0811 11:45:37.733742 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:37.733746 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:37.733854 (+ 108us) server_negotiation.cc:407] Connection header received
0811 11:45:37.734006 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:37.734009 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:37.734058 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:37.734141 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:37.734407 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.734980 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.736325 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.736915 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.737040 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.737113 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:37.737274 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 11:45:37.737347 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 11:45:37.737493 31316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.733384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:38853 (local address 127.20.244.67:53219)
0811 11:45:37.733746 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:37.733759 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:37.733894 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:37.734157 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:37.734160 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:37.734176 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:37.734298 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.734303 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.735143 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.735146 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.736199 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.736209 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.737042 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.737047 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.737150 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.737177 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 11:45:37.737256 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 11:45:37.737325 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"mutex_wait_us":25,"thread_start_us":105,"threads_started":1}
I20260811 11:45:37.737776 31270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.733264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:53103 (local address 127.20.244.65:46039)
0811 11:45:37.733420 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:37.733425 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:37.733441 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:45:37.733497 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:37.733501 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:37.733547 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:37.733626 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:37.734031 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.734832 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.736430 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.737026 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.737126 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.737178 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:37.737557 (+ 379us) server_negotiation.cc:299] Negotiation successful
0811 11:45:37.737634 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 11:45:37.738018 31103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.733131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:46039 (local address 127.20.244.67:53103)
0811 11:45:37.733273 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:37.733291 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:37.733378 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:37.733752 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:37.733755 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:37.733778 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:37.733904 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.733911 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.734965 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.734969 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.736316 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.736328 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.737187 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.737194 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.737311 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.737332 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 11:45:37.737402 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 11:45:37.737483 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":31}
I20260811 11:45:37.738329 31007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c2f43a3fb904c378db9b936b41473eb" candidate_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cff21cb0730e495f9e43bbd3a4078be6" is_pre_election: true
I20260811 11:45:37.738525 31007 raft_consensus.cc:2454] T 6c2f43a3fb904c378db9b936b41473eb P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07349c4d8c124d50b4ce4a4944e66c0b in term 0.
I20260811 11:45:37.738610 30835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c2f43a3fb904c378db9b936b41473eb" candidate_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8a250514fe044ba9bf099e83c275a99" is_pre_election: true
I20260811 11:45:37.738862 30835 raft_consensus.cc:2454] T 6c2f43a3fb904c378db9b936b41473eb P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07349c4d8c124d50b4ce4a4944e66c0b in term 0.
I20260811 11:45:37.738898 31094 leader_election.cc:302] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07349c4d8c124d50b4ce4a4944e66c0b, cff21cb0730e495f9e43bbd3a4078be6; no voters:
I20260811 11:45:37.739197 31286 raft_consensus.cc:2781] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:45:37.739256 31286 raft_consensus.cc:482] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:45:37.739293 31286 raft_consensus.cc:3037] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:37.740552 31286 raft_consensus.cc:504] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:37.740955 31286 leader_election.cc:288] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b [CANDIDATE]: Term 1 election: Requested vote from peers e8a250514fe044ba9bf099e83c275a99 (127.20.244.65:46039), cff21cb0730e495f9e43bbd3a4078be6 (127.20.244.66:38853)
I20260811 11:45:37.741281 30835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c2f43a3fb904c378db9b936b41473eb" candidate_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8a250514fe044ba9bf099e83c275a99"
I20260811 11:45:37.741346 31007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c2f43a3fb904c378db9b936b41473eb" candidate_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cff21cb0730e495f9e43bbd3a4078be6"
I20260811 11:45:37.741413 30835 raft_consensus.cc:3037] T 6c2f43a3fb904c378db9b936b41473eb P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:37.741446 31007 raft_consensus.cc:3037] T 6c2f43a3fb904c378db9b936b41473eb P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:37.742573 30835 raft_consensus.cc:2454] T 6c2f43a3fb904c378db9b936b41473eb P e8a250514fe044ba9bf099e83c275a99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07349c4d8c124d50b4ce4a4944e66c0b in term 1.
I20260811 11:45:37.742573 31007 raft_consensus.cc:2454] T 6c2f43a3fb904c378db9b936b41473eb P cff21cb0730e495f9e43bbd3a4078be6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07349c4d8c124d50b4ce4a4944e66c0b in term 1.
I20260811 11:45:37.742889 31094 leader_election.cc:302] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07349c4d8c124d50b4ce4a4944e66c0b, e8a250514fe044ba9bf099e83c275a99; no voters:
I20260811 11:45:37.743067 31286 raft_consensus.cc:2781] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:37.743402 31286 raft_consensus.cc:686] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b [term 1 LEADER]: Becoming Leader. State: Replica: 07349c4d8c124d50b4ce4a4944e66c0b, State: Running, Role: LEADER
I20260811 11:45:37.743670 31286 consensus_queue.cc:237] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:37.746173 30635 catalog_manager.cc:5495] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 07349c4d8c124d50b4ce4a4944e66c0b (127.20.244.67). New cstate: current_term: 1 leader_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } health_report { overall_health: HEALTHY } } }
Aug 11 11:45:37 dist-test-slave-vkjp krb5kdc[30585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448736, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.126@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM
I20260811 11:45:37.792101 31324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.776712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:36299 (local address 127.0.0.1:39310)
0811 11:45:37.777053 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:37.777066 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:37.777167 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:37.777430 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:37.777432 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:37.777787 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:37.777883 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.777889 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.779206 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.779209 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.779760 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:37.779767 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.780429 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.780431 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:37.780501 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.787136 (+ 6635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:37.787154 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:37.788639 (+ 1485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:37.790528 (+ 1889us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:37.790537 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:37.790541 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:37.790764 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:37.791068 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:37.791071 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:37.791072 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:37.791201 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:37.791646 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:37.791650 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:37.791755 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 11:45:37.791845 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 11:45:37.791962 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":130,"threads_started":1}
I20260811 11:45:37.792239 30694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:37.776831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39310 (local address 127.20.244.126:36299)
0811 11:45:37.776985 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:37.776993 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:37.777146 (+ 153us) server_negotiation.cc:407] Connection header received
0811 11:45:37.777239 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:37.777242 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:37.777302 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:37.777404 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:37.778193 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.779028 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.779883 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:37.780322 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:37.780426 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:37.788809 (+ 8383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:37.788816 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:37.788822 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:37.788851 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:37.790408 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:37.790859 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:37.790863 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:37.790865 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:37.790962 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:37.791298 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:37.791301 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:37.791303 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:37.791540 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:37.791642 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:37.791924 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 11:45:37.792053 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 11:45:37.796100 30635 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:39310:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 11:45:37.796816 30635 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:45:37.801918 30809 tablet_service.cc:1467] Processing CreateTablet for tablet cc9068ecc397490e9f7d888cf0214c00 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7b6af38d541748af94577e7471cdfb2b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 11:45:37.802035 30986 tablet_service.cc:1467] Processing CreateTablet for tablet cc9068ecc397490e9f7d888cf0214c00 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7b6af38d541748af94577e7471cdfb2b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 11:45:37.802350 30809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc9068ecc397490e9f7d888cf0214c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:37.802416 30986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc9068ecc397490e9f7d888cf0214c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:37.802291 31156 tablet_service.cc:1467] Processing CreateTablet for tablet cc9068ecc397490e9f7d888cf0214c00 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7b6af38d541748af94577e7471cdfb2b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 11:45:37.802634 31156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc9068ecc397490e9f7d888cf0214c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:37.805416 31281 tablet_bootstrap.cc:492] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6: Bootstrap starting.
I20260811 11:45:37.805886 31275 tablet_bootstrap.cc:492] T cc9068ecc397490e9f7d888cf0214c00 P 07349c4d8c124d50b4ce4a4944e66c0b: Bootstrap starting.
I20260811 11:45:37.806412 31281 tablet_bootstrap.cc:654] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:37.806658 31275 tablet_bootstrap.cc:654] T cc9068ecc397490e9f7d888cf0214c00 P 07349c4d8c124d50b4ce4a4944e66c0b: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:37.807149 31277 tablet_bootstrap.cc:492] T cc9068ecc397490e9f7d888cf0214c00 P e8a250514fe044ba9bf099e83c275a99: Bootstrap starting.
I20260811 11:45:37.808125 31277 tablet_bootstrap.cc:654] T cc9068ecc397490e9f7d888cf0214c00 P e8a250514fe044ba9bf099e83c275a99: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:37.808799 31275 tablet_bootstrap.cc:492] T cc9068ecc397490e9f7d888cf0214c00 P 07349c4d8c124d50b4ce4a4944e66c0b: No bootstrap required, opened a new log
I20260811 11:45:37.808887 31275 ts_tablet_manager.cc:1397] T cc9068ecc397490e9f7d888cf0214c00 P 07349c4d8c124d50b4ce4a4944e66c0b: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 11:45:37.809127 31281 tablet_bootstrap.cc:492] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6: No bootstrap required, opened a new log
I20260811 11:45:37.809207 31281 ts_tablet_manager.cc:1397] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260811 11:45:37.809309 31275 raft_consensus.cc:348] T cc9068ecc397490e9f7d888cf0214c00 P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:37.809403 31275 raft_consensus.cc:374] T cc9068ecc397490e9f7d888cf0214c00 P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:37.809423 31275 raft_consensus.cc:729] T cc9068ecc397490e9f7d888cf0214c00 P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07349c4d8c124d50b4ce4a4944e66c0b, State: Initialized, Role: FOLLOWER
I20260811 11:45:37.809551 31275 consensus_queue.cc:260] T cc9068ecc397490e9f7d888cf0214c00 P 07349c4d8c124d50b4ce4a4944e66c0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:37.809652 31281 raft_consensus.cc:348] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:37.809762 31281 raft_consensus.cc:374] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:37.809795 31281 raft_consensus.cc:729] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cff21cb0730e495f9e43bbd3a4078be6, State: Initialized, Role: FOLLOWER
I20260811 11:45:37.809777 31286 tablet_replica.cc:439] T cc9068ecc397490e9f7d888cf0214c00 P 07349c4d8c124d50b4ce4a4944e66c0b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } } }
I20260811 11:45:37.809923 31286 tablet_replica.cc:442] T cc9068ecc397490e9f7d888cf0214c00 P 07349c4d8c124d50b4ce4a4944e66c0b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:45:37.809912 31281 consensus_queue.cc:260] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:37.810169 31281 ts_tablet_manager.cc:1428] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 11:45:37.809849 31275 ts_tablet_manager.cc:1428] T cc9068ecc397490e9f7d888cf0214c00 P 07349c4d8c124d50b4ce4a4944e66c0b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 11:45:37.811267 31277 tablet_bootstrap.cc:492] T cc9068ecc397490e9f7d888cf0214c00 P e8a250514fe044ba9bf099e83c275a99: No bootstrap required, opened a new log
I20260811 11:45:37.811378 31277 ts_tablet_manager.cc:1397] T cc9068ecc397490e9f7d888cf0214c00 P e8a250514fe044ba9bf099e83c275a99: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 11:45:37.811811 31277 raft_consensus.cc:348] T cc9068ecc397490e9f7d888cf0214c00 P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:37.811934 31277 raft_consensus.cc:374] T cc9068ecc397490e9f7d888cf0214c00 P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:37.811975 31277 raft_consensus.cc:729] T cc9068ecc397490e9f7d888cf0214c00 P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8a250514fe044ba9bf099e83c275a99, State: Initialized, Role: FOLLOWER
I20260811 11:45:37.812091 31277 consensus_queue.cc:260] T cc9068ecc397490e9f7d888cf0214c00 P e8a250514fe044ba9bf099e83c275a99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:37.812677 31287 tablet_replica.cc:439] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } } }
I20260811 11:45:37.812834 31287 tablet_replica.cc:442] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:45:37.813083 31303 tablet_replica.cc:439] T cc9068ecc397490e9f7d888cf0214c00 P e8a250514fe044ba9bf099e83c275a99: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } } }
I20260811 11:45:37.813236 31303 tablet_replica.cc:442] T cc9068ecc397490e9f7d888cf0214c00 P e8a250514fe044ba9bf099e83c275a99: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:45:37.813834 31277 ts_tablet_manager.cc:1428] T cc9068ecc397490e9f7d888cf0214c00 P e8a250514fe044ba9bf099e83c275a99: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260811 11:45:37.927968 31243 tablet.cc:2369] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:45:38.100337 31287 raft_consensus.cc:482] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:45:38.100502 31287 raft_consensus.cc:504] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:38.101663 31287 leader_election.cc:288] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8a250514fe044ba9bf099e83c275a99 (127.20.244.65:46039), 07349c4d8c124d50b4ce4a4944e66c0b (127.20.244.67:43989)
I20260811 11:45:38.105542 31273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:38.102021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:38359 (local address 127.20.244.67:43989)
0811 11:45:38.102184 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:38.102190 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:38.102346 (+ 156us) server_negotiation.cc:407] Connection header received
0811 11:45:38.102523 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:38.102528 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:38.102575 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:38.102657 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:38.102927 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.103504 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.104594 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.104987 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.105114 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:38.105168 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:38.105348 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 11:45:38.105418 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 11:45:38.105568 31329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:38.101900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:43989 (local address 127.20.244.66:38359)
0811 11:45:38.102237 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:38.102254 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:38.102402 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:38.102673 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:38.102676 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:38.102693 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:38.102823 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:38.102829 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.103618 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.103621 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:38.104469 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:38.104479 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.105113 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.105117 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:38.105213 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:38.105242 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 11:45:38.105330 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 11:45:38.105402 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"mutex_wait_us":28,"thread_start_us":76,"threads_started":1}
I20260811 11:45:38.105820 31270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:38.102046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:54203 (local address 127.20.244.65:46039)
0811 11:45:38.102198 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:38.102205 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:38.102490 (+ 285us) server_negotiation.cc:407] Connection header received
0811 11:45:38.102666 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:38.102669 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:38.102725 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:38.102824 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:45:38.103168 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.103670 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.104775 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.105169 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.105320 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:38.105376 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:38.105573 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 11:45:38.105663 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 11:45:38.105991 31182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc9068ecc397490e9f7d888cf0214c00" candidate_uuid: "cff21cb0730e495f9e43bbd3a4078be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" is_pre_election: true
I20260811 11:45:38.106153 31182 raft_consensus.cc:2454] T cc9068ecc397490e9f7d888cf0214c00 P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cff21cb0730e495f9e43bbd3a4078be6 in term 0.
I20260811 11:45:38.106254 31330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:38.101900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:46039 (local address 127.20.244.66:54203)
0811 11:45:38.102372 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:38.102385 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:38.102531 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:38.102839 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:38.102842 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:38.102860 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:45:38.102995 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:38.103001 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.103795 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.103808 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:38.104631 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:38.104641 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.105311 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.105316 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:38.105422 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:38.105453 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 11:45:38.105553 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 11:45:38.106047 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"mutex_wait_us":174,"thread_start_us":81,"threads_started":1}
I20260811 11:45:38.106582 30930 leader_election.cc:302] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07349c4d8c124d50b4ce4a4944e66c0b, cff21cb0730e495f9e43bbd3a4078be6; no voters:
I20260811 11:45:38.106856 30835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc9068ecc397490e9f7d888cf0214c00" candidate_uuid: "cff21cb0730e495f9e43bbd3a4078be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8a250514fe044ba9bf099e83c275a99" is_pre_election: true
I20260811 11:45:38.106902 31287 raft_consensus.cc:2781] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:45:38.106968 31287 raft_consensus.cc:482] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:45:38.107014 30835 raft_consensus.cc:2454] T cc9068ecc397490e9f7d888cf0214c00 P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cff21cb0730e495f9e43bbd3a4078be6 in term 0.
I20260811 11:45:38.107039 31287 raft_consensus.cc:3037] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:38.108217 31287 raft_consensus.cc:504] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:38.108633 31287 leader_election.cc:288] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6 [CANDIDATE]: Term 1 election: Requested vote from peers e8a250514fe044ba9bf099e83c275a99 (127.20.244.65:46039), 07349c4d8c124d50b4ce4a4944e66c0b (127.20.244.67:43989)
I20260811 11:45:38.108943 30835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc9068ecc397490e9f7d888cf0214c00" candidate_uuid: "cff21cb0730e495f9e43bbd3a4078be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8a250514fe044ba9bf099e83c275a99"
I20260811 11:45:38.109020 31182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc9068ecc397490e9f7d888cf0214c00" candidate_uuid: "cff21cb0730e495f9e43bbd3a4078be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07349c4d8c124d50b4ce4a4944e66c0b"
I20260811 11:45:38.109103 30835 raft_consensus.cc:3037] T cc9068ecc397490e9f7d888cf0214c00 P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:38.109172 31182 raft_consensus.cc:3037] T cc9068ecc397490e9f7d888cf0214c00 P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:38.110041 30835 raft_consensus.cc:2454] T cc9068ecc397490e9f7d888cf0214c00 P e8a250514fe044ba9bf099e83c275a99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cff21cb0730e495f9e43bbd3a4078be6 in term 1.
I20260811 11:45:38.110181 31182 raft_consensus.cc:2454] T cc9068ecc397490e9f7d888cf0214c00 P 07349c4d8c124d50b4ce4a4944e66c0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cff21cb0730e495f9e43bbd3a4078be6 in term 1.
I20260811 11:45:38.110332 30928 leader_election.cc:302] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cff21cb0730e495f9e43bbd3a4078be6, e8a250514fe044ba9bf099e83c275a99; no voters:
I20260811 11:45:38.110530 31287 raft_consensus.cc:2781] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:38.110711 31287 raft_consensus.cc:686] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6 [term 1 LEADER]: Becoming Leader. State: Replica: cff21cb0730e495f9e43bbd3a4078be6, State: Running, Role: LEADER
I20260811 11:45:38.110978 31287 consensus_queue.cc:237] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:38.112381 31332 tablet_replica.cc:439] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6: TxnStatusTablet state changed. Reason: New leader cff21cb0730e495f9e43bbd3a4078be6. Latest consensus state: current_term: 1 leader_uuid: "cff21cb0730e495f9e43bbd3a4078be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } } }
I20260811 11:45:38.112504 31332 tablet_replica.cc:442] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6: This TxnStatusTablet replica's current role is: LEADER
I20260811 11:45:38.112784 31334 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 11:45:38.112936 31334 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 11:45:38.113798 30634 catalog_manager.cc:5495] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6 reported cstate change: term changed from 0 to 1, leader changed from <none> to cff21cb0730e495f9e43bbd3a4078be6 (127.20.244.66). New cstate: current_term: 1 leader_uuid: "cff21cb0730e495f9e43bbd3a4078be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } health_report { overall_health: UNKNOWN } } }
I20260811 11:45:38.175889 31324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:38.171486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:38853 (local address 127.0.0.1:43392)
0811 11:45:38.171644 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:38.171661 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:38.171766 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:38.172131 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:38.172133 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:38.172139 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 11:45:38.172238 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:38.172242 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.173245 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.173247 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:38.173847 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:38.173855 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.174479 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.174484 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:38.174580 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:38.174643 (+ 63us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 11:45:38.175605 (+ 962us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 11:45:38.175620 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 11:45:38.175684 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 11:45:38.175766 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 11:45:38.175949 31274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:38.171582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43392 (local address 127.20.244.66:38853)
0811 11:45:38.171732 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:38.171747 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:38.171766 (+ 19us) server_negotiation.cc:407] Connection header received
0811 11:45:38.171921 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:38.171925 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:38.172001 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:38.172127 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:45:38.172343 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.173139 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.173970 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.174324 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.174445 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:38.174826 (+ 381us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:45:38.175493 (+ 667us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:45:38.175623 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:38.175725 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 11:45:38.175800 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 11:45:38.179580 31182 raft_consensus.cc:1261] T cc9068ecc397490e9f7d888cf0214c00 P 07349c4d8c124d50b4ce4a4944e66c0b [term 1 FOLLOWER]: Refusing update from remote peer cff21cb0730e495f9e43bbd3a4078be6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:38.179809 30835 raft_consensus.cc:1261] T cc9068ecc397490e9f7d888cf0214c00 P e8a250514fe044ba9bf099e83c275a99 [term 1 FOLLOWER]: Refusing update from remote peer cff21cb0730e495f9e43bbd3a4078be6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:38.180466 31332 consensus_queue.cc:1035] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:38.180753 31287 consensus_queue.cc:1035] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:38.182258 31286 tablet_replica.cc:439] T cc9068ecc397490e9f7d888cf0214c00 P 07349c4d8c124d50b4ce4a4944e66c0b: TxnStatusTablet state changed. Reason: New leader cff21cb0730e495f9e43bbd3a4078be6. Latest consensus state: current_term: 1 leader_uuid: "cff21cb0730e495f9e43bbd3a4078be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } } }
I20260811 11:45:38.182382 31286 tablet_replica.cc:442] T cc9068ecc397490e9f7d888cf0214c00 P 07349c4d8c124d50b4ce4a4944e66c0b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:45:38.182732 31303 tablet_replica.cc:439] T cc9068ecc397490e9f7d888cf0214c00 P e8a250514fe044ba9bf099e83c275a99: TxnStatusTablet state changed. Reason: New leader cff21cb0730e495f9e43bbd3a4078be6. Latest consensus state: current_term: 1 leader_uuid: "cff21cb0730e495f9e43bbd3a4078be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } } }
I20260811 11:45:38.182865 31303 tablet_replica.cc:442] T cc9068ecc397490e9f7d888cf0214c00 P e8a250514fe044ba9bf099e83c275a99: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:45:38.184731 31287 tablet_replica.cc:439] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cff21cb0730e495f9e43bbd3a4078be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } } }
I20260811 11:45:38.184859 31287 tablet_replica.cc:442] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6: This TxnStatusTablet replica's current role is: LEADER
I20260811 11:45:38.185211 31303 tablet_replica.cc:439] T cc9068ecc397490e9f7d888cf0214c00 P e8a250514fe044ba9bf099e83c275a99: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cff21cb0730e495f9e43bbd3a4078be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } } }
I20260811 11:45:38.185321 31303 tablet_replica.cc:442] T cc9068ecc397490e9f7d888cf0214c00 P e8a250514fe044ba9bf099e83c275a99: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:45:38.186000 31287 tablet_replica.cc:439] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cff21cb0730e495f9e43bbd3a4078be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } } }
I20260811 11:45:38.186110 31287 tablet_replica.cc:442] T cc9068ecc397490e9f7d888cf0214c00 P cff21cb0730e495f9e43bbd3a4078be6: This TxnStatusTablet replica's current role is: LEADER
I20260811 11:45:38.186846 31286 tablet_replica.cc:439] T cc9068ecc397490e9f7d888cf0214c00 P 07349c4d8c124d50b4ce4a4944e66c0b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cff21cb0730e495f9e43bbd3a4078be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } } }
I20260811 11:45:38.186969 31286 tablet_replica.cc:442] T cc9068ecc397490e9f7d888cf0214c00 P 07349c4d8c124d50b4ce4a4944e66c0b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:45:38.199411 31273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:38.195343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37028 (local address 127.20.244.67:43989)
0811 11:45:38.195466 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:38.195470 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:38.195690 (+ 220us) server_negotiation.cc:407] Connection header received
0811 11:45:38.195879 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:38.195882 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:38.195948 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:38.196059 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:45:38.196299 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.196810 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.197729 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.198054 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.198155 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:38.198424 (+ 269us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:45:38.198931 (+ 507us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:45:38.199063 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:38.199208 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 11:45:38.199260 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 11:45:38.210449 31274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:38.206131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:60617 (local address 127.20.244.66:38853)
0811 11:45:38.206262 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:38.206267 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:38.206550 (+ 283us) server_negotiation.cc:407] Connection header received
0811 11:45:38.206728 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:38.206731 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:38.206781 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:38.206844 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:45:38.207235 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.207954 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.209168 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.209513 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.209611 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:38.209982 (+ 371us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:45:38.210059 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:45:38.210121 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:38.210264 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 11:45:38.210320 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 11:45:38.210748 31356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:38.205978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:38853 (local address 127.20.244.67:60617)
0811 11:45:38.206433 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:38.206453 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:38.206608 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:38.206881 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:38.206884 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:38.206893 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 11:45:38.207048 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:38.207056 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.208083 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.208087 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:38.209031 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:38.209043 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.209647 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.209652 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:38.209765 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:38.209825 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 11:45:38.210150 (+ 325us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 11:45:38.210159 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 11:45:38.210245 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 11:45:38.210333 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":105,"threads_started":1}
I20260811 11:45:38.219026 31007 raft_consensus.cc:1261] T 6c2f43a3fb904c378db9b936b41473eb P cff21cb0730e495f9e43bbd3a4078be6 [term 1 FOLLOWER]: Refusing update from remote peer 07349c4d8c124d50b4ce4a4944e66c0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:38.219156 30835 raft_consensus.cc:1261] T 6c2f43a3fb904c378db9b936b41473eb P e8a250514fe044ba9bf099e83c275a99 [term 1 FOLLOWER]: Refusing update from remote peer 07349c4d8c124d50b4ce4a4944e66c0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:38.219870 31317 consensus_queue.cc:1035] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:38.220244 31317 consensus_queue.cc:1035] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:38.247535 31273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:38.243141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:56495 (local address 127.20.244.67:43989)
0811 11:45:38.243248 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:38.243253 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:38.243552 (+ 299us) server_negotiation.cc:407] Connection header received
0811 11:45:38.243988 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:38.243992 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:38.244048 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:38.244097 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:45:38.244527 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.245019 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.246298 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.246618 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.246722 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:38.247116 (+ 394us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:45:38.247194 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:45:38.247251 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:38.247390 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 11:45:38.247432 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 11:45:38.247643 31362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:38.243071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:43989 (local address 127.20.244.66:56495)
0811 11:45:38.243464 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:38.243481 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:38.243633 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:38.244246 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:38.244249 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:38.244257 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 11:45:38.244404 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:38.244412 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.245142 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.245146 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:38.246174 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:38.246187 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.246795 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.246800 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:38.246904 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:38.246959 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 11:45:38.247292 (+ 333us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 11:45:38.247300 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 11:45:38.247386 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 11:45:38.247472 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":84,"threads_started":1}
I20260811 11:45:38.275305 30634 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:38.275504 30634 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:38.278040 30634 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90: Sending DeleteTablet for 3 replicas of tablet 6c2f43a3fb904c378db9b936b41473eb
I20260811 11:45:38.278806 31156 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c2f43a3fb904c378db9b936b41473eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:38 UTC) from {username='oryx', principal='oryx/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:37018
I20260811 11:45:38.278895 30809 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c2f43a3fb904c378db9b936b41473eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:38 UTC) from {username='oryx', principal='oryx/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:47568
I20260811 11:45:38.279414 31368 tablet_replica.cc:330] T 6c2f43a3fb904c378db9b936b41473eb P e8a250514fe044ba9bf099e83c275a99: stopping tablet replica
I20260811 11:45:38.279652 30986 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c2f43a3fb904c378db9b936b41473eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:38 UTC) from {username='oryx', principal='oryx/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:43376
I20260811 11:45:38.279970 31369 tablet_replica.cc:330] T 6c2f43a3fb904c378db9b936b41473eb P cff21cb0730e495f9e43bbd3a4078be6: stopping tablet replica
I20260811 11:45:38.280085 31369 raft_consensus.cc:2229] T 6c2f43a3fb904c378db9b936b41473eb P cff21cb0730e495f9e43bbd3a4078be6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:38.280197 31369 raft_consensus.cc:2258] T 6c2f43a3fb904c378db9b936b41473eb P cff21cb0730e495f9e43bbd3a4078be6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:38.280467 31366 tablet_replica.cc:330] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b: stopping tablet replica
I20260811 11:45:38.280586 31366 raft_consensus.cc:2229] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:45:38.280876 31366 raft_consensus.cc:2258] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:38.281749 31369 ts_tablet_manager.cc:1905] T 6c2f43a3fb904c378db9b936b41473eb P cff21cb0730e495f9e43bbd3a4078be6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:38.283396 31368 raft_consensus.cc:2229] T 6c2f43a3fb904c378db9b936b41473eb P e8a250514fe044ba9bf099e83c275a99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:38.283592 31368 raft_consensus.cc:2258] T 6c2f43a3fb904c378db9b936b41473eb P e8a250514fe044ba9bf099e83c275a99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:38.284880 31369 ts_tablet_manager.cc:1918] T 6c2f43a3fb904c378db9b936b41473eb P cff21cb0730e495f9e43bbd3a4078be6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:45:38.284969 31369 log.cc:1196] T 6c2f43a3fb904c378db9b936b41473eb P cff21cb0730e495f9e43bbd3a4078be6: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/6c2f43a3fb904c378db9b936b41473eb
I20260811 11:45:38.285261 31369 ts_tablet_manager.cc:1939] T 6c2f43a3fb904c378db9b936b41473eb P cff21cb0730e495f9e43bbd3a4078be6: Deleting consensus metadata
I20260811 11:45:38.285560 31368 ts_tablet_manager.cc:1905] T 6c2f43a3fb904c378db9b936b41473eb P e8a250514fe044ba9bf099e83c275a99: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:38.286012 30620 catalog_manager.cc:4841] TS cff21cb0730e495f9e43bbd3a4078be6 (127.20.244.66:38853): tablet 6c2f43a3fb904c378db9b936b41473eb (table test-table [id=a0911bbe6de44206ad45916562cb1b49]) successfully deleted
I20260811 11:45:38.286755 31366 ts_tablet_manager.cc:1905] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:38.288731 31368 ts_tablet_manager.cc:1918] T 6c2f43a3fb904c378db9b936b41473eb P e8a250514fe044ba9bf099e83c275a99: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:45:38.289357 31368 log.cc:1196] T 6c2f43a3fb904c378db9b936b41473eb P e8a250514fe044ba9bf099e83c275a99: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-0/wal/wals/6c2f43a3fb904c378db9b936b41473eb
I20260811 11:45:38.289482 31366 ts_tablet_manager.cc:1918] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:45:38.289565 31366 log.cc:1196] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/6c2f43a3fb904c378db9b936b41473eb
I20260811 11:45:38.289808 31368 ts_tablet_manager.cc:1939] T 6c2f43a3fb904c378db9b936b41473eb P e8a250514fe044ba9bf099e83c275a99: Deleting consensus metadata
I20260811 11:45:38.289837 31366 ts_tablet_manager.cc:1939] T 6c2f43a3fb904c378db9b936b41473eb P 07349c4d8c124d50b4ce4a4944e66c0b: Deleting consensus metadata
I20260811 11:45:38.290583 30620 catalog_manager.cc:4841] TS e8a250514fe044ba9bf099e83c275a99 (127.20.244.65:46039): tablet 6c2f43a3fb904c378db9b936b41473eb (table test-table [id=a0911bbe6de44206ad45916562cb1b49]) successfully deleted
I20260811 11:45:38.290625 30622 catalog_manager.cc:4841] TS 07349c4d8c124d50b4ce4a4944e66c0b (127.20.244.67:43989): tablet 6c2f43a3fb904c378db9b936b41473eb (table test-table [id=a0911bbe6de44206ad45916562cb1b49]) successfully deleted
Aug 11 11:45:38 dist-test-slave-vkjp krb5kdc[30585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 11:45:38 dist-test-slave-vkjp krb5kdc[30585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:38 dist-test-slave-vkjp krb5kdc[30585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 11:45:38.318600 31382 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:38.311532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39312 (local address 127.20.244.126:36299)
0811 11:45:38.311773 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:38.311777 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:38.311827 (+ 50us) server_negotiation.cc:407] Connection header received
0811 11:45:38.311978 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:38.311980 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:38.312027 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:38.312106 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:38.312981 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.313518 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.314751 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.314974 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.315054 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:38.318438 (+ 3384us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39312: BlockingRecv error: recv got EOF from 127.0.0.1:39312 (error 108)
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":63,"threads_started":1}
Aug 11 11:45:38 dist-test-slave-vkjp krb5kdc[30585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM
I20260811 11:45:38.328718 31382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:38.320191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39320 (local address 127.20.244.126:36299)
0811 11:45:38.320326 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:38.320331 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:38.320514 (+ 183us) server_negotiation.cc:407] Connection header received
0811 11:45:38.320649 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:38.320652 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:38.320703 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:38.320788 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:38.321457 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.322040 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.322806 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.323125 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.323223 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:38.325449 (+ 2226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:38.325453 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:38.325456 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:38.325488 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:38.327007 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:38.327491 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:38.327496 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:38.327498 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:38.327582 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:38.327860 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:38.327864 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:38.327865 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:38.328055 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:38.328194 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:38.328424 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 11:45:38.328548 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 11:45:38.331390 30634 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39320:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:45:38.331881 30634 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:45:38.336632 30809 tablet_service.cc:1467] Processing CreateTablet for tablet 716a289017a648cea61bc064da2c41bf (DEFAULT_TABLE table=test-table [id=3cf6b7268f5342c080aa97d4b8a4647b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:38.336740 30986 tablet_service.cc:1467] Processing CreateTablet for tablet 716a289017a648cea61bc064da2c41bf (DEFAULT_TABLE table=test-table [id=3cf6b7268f5342c080aa97d4b8a4647b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:38.336943 30809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 716a289017a648cea61bc064da2c41bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:38.337090 30986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 716a289017a648cea61bc064da2c41bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:38.339320 31156 tablet_service.cc:1467] Processing CreateTablet for tablet 716a289017a648cea61bc064da2c41bf (DEFAULT_TABLE table=test-table [id=3cf6b7268f5342c080aa97d4b8a4647b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:38.339732 31156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 716a289017a648cea61bc064da2c41bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:38.339890 31390 tablet_bootstrap.cc:492] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6: Bootstrap starting.
I20260811 11:45:38.340826 31390 tablet_bootstrap.cc:654] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:38.342274 31394 tablet_bootstrap.cc:492] T 716a289017a648cea61bc064da2c41bf P 07349c4d8c124d50b4ce4a4944e66c0b: Bootstrap starting.
I20260811 11:45:38.342777 31390 tablet_bootstrap.cc:492] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6: No bootstrap required, opened a new log
I20260811 11:45:38.342794 31392 tablet_bootstrap.cc:492] T 716a289017a648cea61bc064da2c41bf P e8a250514fe044ba9bf099e83c275a99: Bootstrap starting.
I20260811 11:45:38.342880 31390 ts_tablet_manager.cc:1397] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 11:45:38.343425 31394 tablet_bootstrap.cc:654] T 716a289017a648cea61bc064da2c41bf P 07349c4d8c124d50b4ce4a4944e66c0b: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:38.343346 31390 raft_consensus.cc:348] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:38.343472 31390 raft_consensus.cc:374] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:38.343515 31390 raft_consensus.cc:729] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cff21cb0730e495f9e43bbd3a4078be6, State: Initialized, Role: FOLLOWER
I20260811 11:45:38.343722 31392 tablet_bootstrap.cc:654] T 716a289017a648cea61bc064da2c41bf P e8a250514fe044ba9bf099e83c275a99: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:38.343678 31390 consensus_queue.cc:260] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:38.343974 31390 ts_tablet_manager.cc:1428] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:38.345497 31392 tablet_bootstrap.cc:492] T 716a289017a648cea61bc064da2c41bf P e8a250514fe044ba9bf099e83c275a99: No bootstrap required, opened a new log
I20260811 11:45:38.345598 31392 ts_tablet_manager.cc:1397] T 716a289017a648cea61bc064da2c41bf P e8a250514fe044ba9bf099e83c275a99: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 11:45:38.346063 31394 tablet_bootstrap.cc:492] T 716a289017a648cea61bc064da2c41bf P 07349c4d8c124d50b4ce4a4944e66c0b: No bootstrap required, opened a new log
I20260811 11:45:38.346153 31394 ts_tablet_manager.cc:1397] T 716a289017a648cea61bc064da2c41bf P 07349c4d8c124d50b4ce4a4944e66c0b: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 11:45:38.346601 31394 raft_consensus.cc:348] T 716a289017a648cea61bc064da2c41bf P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:38.346711 31394 raft_consensus.cc:374] T 716a289017a648cea61bc064da2c41bf P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:38.346743 31394 raft_consensus.cc:729] T 716a289017a648cea61bc064da2c41bf P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07349c4d8c124d50b4ce4a4944e66c0b, State: Initialized, Role: FOLLOWER
I20260811 11:45:38.346691 31392 raft_consensus.cc:348] T 716a289017a648cea61bc064da2c41bf P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:38.346802 31392 raft_consensus.cc:374] T 716a289017a648cea61bc064da2c41bf P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:38.346894 31392 raft_consensus.cc:729] T 716a289017a648cea61bc064da2c41bf P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8a250514fe044ba9bf099e83c275a99, State: Initialized, Role: FOLLOWER
I20260811 11:45:38.346870 31394 consensus_queue.cc:260] T 716a289017a648cea61bc064da2c41bf P 07349c4d8c124d50b4ce4a4944e66c0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:38.347065 31392 consensus_queue.cc:260] T 716a289017a648cea61bc064da2c41bf P e8a250514fe044ba9bf099e83c275a99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:38.347540 31394 ts_tablet_manager.cc:1428] T 716a289017a648cea61bc064da2c41bf P 07349c4d8c124d50b4ce4a4944e66c0b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:38.348104 31392 ts_tablet_manager.cc:1428] T 716a289017a648cea61bc064da2c41bf P e8a250514fe044ba9bf099e83c275a99: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 11:45:38.414186 31332 raft_consensus.cc:482] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:45:38.414366 31332 raft_consensus.cc:504] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:38.414875 31332 leader_election.cc:288] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8a250514fe044ba9bf099e83c275a99 (127.20.244.65:46039), 07349c4d8c124d50b4ce4a4944e66c0b (127.20.244.67:43989)
I20260811 11:45:38.415323 30835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "716a289017a648cea61bc064da2c41bf" candidate_uuid: "cff21cb0730e495f9e43bbd3a4078be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8a250514fe044ba9bf099e83c275a99" is_pre_election: true
I20260811 11:45:38.415503 30835 raft_consensus.cc:2454] T 716a289017a648cea61bc064da2c41bf P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cff21cb0730e495f9e43bbd3a4078be6 in term 0.
I20260811 11:45:38.415573 31182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "716a289017a648cea61bc064da2c41bf" candidate_uuid: "cff21cb0730e495f9e43bbd3a4078be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" is_pre_election: true
I20260811 11:45:38.415729 31182 raft_consensus.cc:2454] T 716a289017a648cea61bc064da2c41bf P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cff21cb0730e495f9e43bbd3a4078be6 in term 0.
I20260811 11:45:38.415863 30928 leader_election.cc:302] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cff21cb0730e495f9e43bbd3a4078be6, e8a250514fe044ba9bf099e83c275a99; no voters:
I20260811 11:45:38.416090 31332 raft_consensus.cc:2781] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:45:38.416193 31332 raft_consensus.cc:482] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:45:38.416247 31332 raft_consensus.cc:3037] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:38.417659 31332 raft_consensus.cc:504] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:38.418061 31332 leader_election.cc:288] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6 [CANDIDATE]: Term 1 election: Requested vote from peers e8a250514fe044ba9bf099e83c275a99 (127.20.244.65:46039), 07349c4d8c124d50b4ce4a4944e66c0b (127.20.244.67:43989)
I20260811 11:45:38.418516 30835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "716a289017a648cea61bc064da2c41bf" candidate_uuid: "cff21cb0730e495f9e43bbd3a4078be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8a250514fe044ba9bf099e83c275a99"
I20260811 11:45:38.418533 31182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "716a289017a648cea61bc064da2c41bf" candidate_uuid: "cff21cb0730e495f9e43bbd3a4078be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07349c4d8c124d50b4ce4a4944e66c0b"
I20260811 11:45:38.418672 31182 raft_consensus.cc:3037] T 716a289017a648cea61bc064da2c41bf P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:38.418670 30835 raft_consensus.cc:3037] T 716a289017a648cea61bc064da2c41bf P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:38.419799 31182 raft_consensus.cc:2454] T 716a289017a648cea61bc064da2c41bf P 07349c4d8c124d50b4ce4a4944e66c0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cff21cb0730e495f9e43bbd3a4078be6 in term 1.
I20260811 11:45:38.419963 30835 raft_consensus.cc:2454] T 716a289017a648cea61bc064da2c41bf P e8a250514fe044ba9bf099e83c275a99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cff21cb0730e495f9e43bbd3a4078be6 in term 1.
I20260811 11:45:38.420100 30930 leader_election.cc:302] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07349c4d8c124d50b4ce4a4944e66c0b, cff21cb0730e495f9e43bbd3a4078be6; no voters:
I20260811 11:45:38.420403 31332 raft_consensus.cc:2781] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:38.420559 31332 raft_consensus.cc:686] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6 [term 1 LEADER]: Becoming Leader. State: Replica: cff21cb0730e495f9e43bbd3a4078be6, State: Running, Role: LEADER
I20260811 11:45:38.420717 31332 consensus_queue.cc:237] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:38.422461 30634 catalog_manager.cc:5495] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6 reported cstate change: term changed from 0 to 1, leader changed from <none> to cff21cb0730e495f9e43bbd3a4078be6 (127.20.244.66). New cstate: current_term: 1 leader_uuid: "cff21cb0730e495f9e43bbd3a4078be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } health_report { overall_health: UNKNOWN } } }
I20260811 11:45:38.443041 31274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:38.439023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43408 (local address 127.20.244.66:38853)
0811 11:45:38.439165 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:38.439170 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:38.439186 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:45:38.439349 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:38.439352 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:38.439423 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:38.439488 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:45:38.439750 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.440546 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.441764 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.442125 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.442221 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:38.442573 (+ 352us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:45:38.442660 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:45:38.442734 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:38.442843 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 11:45:38.442903 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 11:45:38.445297 31182 raft_consensus.cc:1261] T 716a289017a648cea61bc064da2c41bf P 07349c4d8c124d50b4ce4a4944e66c0b [term 1 FOLLOWER]: Refusing update from remote peer cff21cb0730e495f9e43bbd3a4078be6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:38.445766 31347 consensus_queue.cc:1035] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:38.445935 30835 raft_consensus.cc:1261] T 716a289017a648cea61bc064da2c41bf P e8a250514fe044ba9bf099e83c275a99 [term 1 FOLLOWER]: Refusing update from remote peer cff21cb0730e495f9e43bbd3a4078be6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:38.446470 31347 consensus_queue.cc:1035] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:38.457214 30636 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39320:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:38.457386 30636 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39320:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:38.459524 30636 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90: Sending DeleteTablet for 3 replicas of tablet 716a289017a648cea61bc064da2c41bf
I20260811 11:45:38.460140 30986 tablet_service.cc:1514] Processing DeleteTablet for tablet 716a289017a648cea61bc064da2c41bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:38 UTC) from {username='oryx', principal='oryx/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:43376
I20260811 11:45:38.460175 31156 tablet_service.cc:1514] Processing DeleteTablet for tablet 716a289017a648cea61bc064da2c41bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:38 UTC) from {username='oryx', principal='oryx/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:37018
I20260811 11:45:38.460201 30809 tablet_service.cc:1514] Processing DeleteTablet for tablet 716a289017a648cea61bc064da2c41bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:38 UTC) from {username='oryx', principal='oryx/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:47568
I20260811 11:45:38.460321 31369 tablet_replica.cc:330] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6: stopping tablet replica
I20260811 11:45:38.460352 31366 tablet_replica.cc:330] T 716a289017a648cea61bc064da2c41bf P 07349c4d8c124d50b4ce4a4944e66c0b: stopping tablet replica
I20260811 11:45:38.460381 31368 tablet_replica.cc:330] T 716a289017a648cea61bc064da2c41bf P e8a250514fe044ba9bf099e83c275a99: stopping tablet replica
I20260811 11:45:38.460438 31369 raft_consensus.cc:2229] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:45:38.460457 31366 raft_consensus.cc:2229] T 716a289017a648cea61bc064da2c41bf P 07349c4d8c124d50b4ce4a4944e66c0b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:38.460487 31368 raft_consensus.cc:2229] T 716a289017a648cea61bc064da2c41bf P e8a250514fe044ba9bf099e83c275a99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:38.460582 31366 raft_consensus.cc:2258] T 716a289017a648cea61bc064da2c41bf P 07349c4d8c124d50b4ce4a4944e66c0b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:38.460608 31368 raft_consensus.cc:2258] T 716a289017a648cea61bc064da2c41bf P e8a250514fe044ba9bf099e83c275a99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:38.460726 31369 raft_consensus.cc:2258] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:38.461335 31368 ts_tablet_manager.cc:1905] T 716a289017a648cea61bc064da2c41bf P e8a250514fe044ba9bf099e83c275a99: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:38.461335 31366 ts_tablet_manager.cc:1905] T 716a289017a648cea61bc064da2c41bf P 07349c4d8c124d50b4ce4a4944e66c0b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:38.461467 31369 ts_tablet_manager.cc:1905] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:38.462229 30636 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39320:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:45:38.462651 30636 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:45:38.463860 31366 ts_tablet_manager.cc:1918] T 716a289017a648cea61bc064da2c41bf P 07349c4d8c124d50b4ce4a4944e66c0b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:45:38.463879 31368 ts_tablet_manager.cc:1918] T 716a289017a648cea61bc064da2c41bf P e8a250514fe044ba9bf099e83c275a99: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:45:38.463944 31368 log.cc:1196] T 716a289017a648cea61bc064da2c41bf P e8a250514fe044ba9bf099e83c275a99: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-0/wal/wals/716a289017a648cea61bc064da2c41bf
I20260811 11:45:38.463955 31366 log.cc:1196] T 716a289017a648cea61bc064da2c41bf P 07349c4d8c124d50b4ce4a4944e66c0b: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/716a289017a648cea61bc064da2c41bf
I20260811 11:45:38.464053 31369 ts_tablet_manager.cc:1918] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:45:38.464126 31369 log.cc:1196] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/716a289017a648cea61bc064da2c41bf
I20260811 11:45:38.464217 31368 ts_tablet_manager.cc:1939] T 716a289017a648cea61bc064da2c41bf P e8a250514fe044ba9bf099e83c275a99: Deleting consensus metadata
I20260811 11:45:38.464600 31366 ts_tablet_manager.cc:1939] T 716a289017a648cea61bc064da2c41bf P 07349c4d8c124d50b4ce4a4944e66c0b: Deleting consensus metadata
I20260811 11:45:38.465137 30620 catalog_manager.cc:4841] TS e8a250514fe044ba9bf099e83c275a99 (127.20.244.65:46039): tablet 716a289017a648cea61bc064da2c41bf (table test-table [id=3cf6b7268f5342c080aa97d4b8a4647b]) successfully deleted
I20260811 11:45:38.465342 30622 catalog_manager.cc:4841] TS 07349c4d8c124d50b4ce4a4944e66c0b (127.20.244.67:43989): tablet 716a289017a648cea61bc064da2c41bf (table test-table [id=3cf6b7268f5342c080aa97d4b8a4647b]) successfully deleted
I20260811 11:45:38.465515 31369 ts_tablet_manager.cc:1939] T 716a289017a648cea61bc064da2c41bf P cff21cb0730e495f9e43bbd3a4078be6: Deleting consensus metadata
I20260811 11:45:38.466221 30620 catalog_manager.cc:4841] TS cff21cb0730e495f9e43bbd3a4078be6 (127.20.244.66:38853): tablet 716a289017a648cea61bc064da2c41bf (table test-table [id=3cf6b7268f5342c080aa97d4b8a4647b]) successfully deleted
I20260811 11:45:38.467741 30809 tablet_service.cc:1467] Processing CreateTablet for tablet 907cfb9438c741f7b4a6f398eae8a1a0 (DEFAULT_TABLE table=test-table [id=3984fac9441045b8a970e622089cfedc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:38.467813 30986 tablet_service.cc:1467] Processing CreateTablet for tablet 907cfb9438c741f7b4a6f398eae8a1a0 (DEFAULT_TABLE table=test-table [id=3984fac9441045b8a970e622089cfedc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:38.468014 30809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 907cfb9438c741f7b4a6f398eae8a1a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:38.468057 30986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 907cfb9438c741f7b4a6f398eae8a1a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:38.470166 31392 tablet_bootstrap.cc:492] T 907cfb9438c741f7b4a6f398eae8a1a0 P e8a250514fe044ba9bf099e83c275a99: Bootstrap starting.
I20260811 11:45:38.470208 31390 tablet_bootstrap.cc:492] T 907cfb9438c741f7b4a6f398eae8a1a0 P cff21cb0730e495f9e43bbd3a4078be6: Bootstrap starting.
I20260811 11:45:38.470871 31390 tablet_bootstrap.cc:654] T 907cfb9438c741f7b4a6f398eae8a1a0 P cff21cb0730e495f9e43bbd3a4078be6: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:38.471043 31392 tablet_bootstrap.cc:654] T 907cfb9438c741f7b4a6f398eae8a1a0 P e8a250514fe044ba9bf099e83c275a99: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:38.471793 31156 tablet_service.cc:1467] Processing CreateTablet for tablet 907cfb9438c741f7b4a6f398eae8a1a0 (DEFAULT_TABLE table=test-table [id=3984fac9441045b8a970e622089cfedc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:45:38.472061 31156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 907cfb9438c741f7b4a6f398eae8a1a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:38.473766 31394 tablet_bootstrap.cc:492] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b: Bootstrap starting.
I20260811 11:45:38.474290 31390 tablet_bootstrap.cc:492] T 907cfb9438c741f7b4a6f398eae8a1a0 P cff21cb0730e495f9e43bbd3a4078be6: No bootstrap required, opened a new log
I20260811 11:45:38.474383 31390 ts_tablet_manager.cc:1397] T 907cfb9438c741f7b4a6f398eae8a1a0 P cff21cb0730e495f9e43bbd3a4078be6: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 11:45:38.474797 31390 raft_consensus.cc:348] T 907cfb9438c741f7b4a6f398eae8a1a0 P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:38.474918 31390 raft_consensus.cc:374] T 907cfb9438c741f7b4a6f398eae8a1a0 P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:38.474959 31390 raft_consensus.cc:729] T 907cfb9438c741f7b4a6f398eae8a1a0 P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cff21cb0730e495f9e43bbd3a4078be6, State: Initialized, Role: FOLLOWER
I20260811 11:45:38.475013 31394 tablet_bootstrap.cc:654] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:38.475090 31390 consensus_queue.cc:260] T 907cfb9438c741f7b4a6f398eae8a1a0 P cff21cb0730e495f9e43bbd3a4078be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:38.475376 31390 ts_tablet_manager.cc:1428] T 907cfb9438c741f7b4a6f398eae8a1a0 P cff21cb0730e495f9e43bbd3a4078be6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:38.476066 31394 tablet_bootstrap.cc:492] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b: No bootstrap required, opened a new log
I20260811 11:45:38.476148 31394 ts_tablet_manager.cc:1397] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:38.476393 31392 tablet_bootstrap.cc:492] T 907cfb9438c741f7b4a6f398eae8a1a0 P e8a250514fe044ba9bf099e83c275a99: No bootstrap required, opened a new log
I20260811 11:45:38.476480 31392 ts_tablet_manager.cc:1397] T 907cfb9438c741f7b4a6f398eae8a1a0 P e8a250514fe044ba9bf099e83c275a99: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260811 11:45:38.476511 31394 raft_consensus.cc:348] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:38.476609 31394 raft_consensus.cc:374] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:38.476639 31394 raft_consensus.cc:729] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07349c4d8c124d50b4ce4a4944e66c0b, State: Initialized, Role: FOLLOWER
I20260811 11:45:38.476749 31394 consensus_queue.cc:260] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:38.476989 31394 ts_tablet_manager.cc:1428] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:38.476900 31392 raft_consensus.cc:348] T 907cfb9438c741f7b4a6f398eae8a1a0 P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:38.477034 31392 raft_consensus.cc:374] T 907cfb9438c741f7b4a6f398eae8a1a0 P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:38.477077 31392 raft_consensus.cc:729] T 907cfb9438c741f7b4a6f398eae8a1a0 P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8a250514fe044ba9bf099e83c275a99, State: Initialized, Role: FOLLOWER
I20260811 11:45:38.477190 31392 consensus_queue.cc:260] T 907cfb9438c741f7b4a6f398eae8a1a0 P e8a250514fe044ba9bf099e83c275a99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:38.477440 31392 ts_tablet_manager.cc:1428] T 907cfb9438c741f7b4a6f398eae8a1a0 P e8a250514fe044ba9bf099e83c275a99: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:45:38.479851 31286 raft_consensus.cc:482] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:45:38.479940 31286 raft_consensus.cc:504] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:38.480278 31286 leader_election.cc:288] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8a250514fe044ba9bf099e83c275a99 (127.20.244.65:46039), cff21cb0730e495f9e43bbd3a4078be6 (127.20.244.66:38853)
I20260811 11:45:38.480693 30835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "907cfb9438c741f7b4a6f398eae8a1a0" candidate_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8a250514fe044ba9bf099e83c275a99" is_pre_election: true
I20260811 11:45:38.480693 31007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "907cfb9438c741f7b4a6f398eae8a1a0" candidate_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cff21cb0730e495f9e43bbd3a4078be6" is_pre_election: true
I20260811 11:45:38.480819 31007 raft_consensus.cc:2454] T 907cfb9438c741f7b4a6f398eae8a1a0 P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07349c4d8c124d50b4ce4a4944e66c0b in term 0.
I20260811 11:45:38.480819 30835 raft_consensus.cc:2454] T 907cfb9438c741f7b4a6f398eae8a1a0 P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07349c4d8c124d50b4ce4a4944e66c0b in term 0.
I20260811 11:45:38.481086 31094 leader_election.cc:302] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07349c4d8c124d50b4ce4a4944e66c0b, e8a250514fe044ba9bf099e83c275a99; no voters:
I20260811 11:45:38.481258 31286 raft_consensus.cc:2781] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:45:38.481317 31286 raft_consensus.cc:482] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:45:38.481359 31286 raft_consensus.cc:3037] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:38.482225 31286 raft_consensus.cc:504] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:38.482605 31286 leader_election.cc:288] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b [CANDIDATE]: Term 1 election: Requested vote from peers e8a250514fe044ba9bf099e83c275a99 (127.20.244.65:46039), cff21cb0730e495f9e43bbd3a4078be6 (127.20.244.66:38853)
I20260811 11:45:38.482905 31007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "907cfb9438c741f7b4a6f398eae8a1a0" candidate_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cff21cb0730e495f9e43bbd3a4078be6"
I20260811 11:45:38.482905 30835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "907cfb9438c741f7b4a6f398eae8a1a0" candidate_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8a250514fe044ba9bf099e83c275a99"
I20260811 11:45:38.483017 31007 raft_consensus.cc:3037] T 907cfb9438c741f7b4a6f398eae8a1a0 P cff21cb0730e495f9e43bbd3a4078be6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:38.483017 30835 raft_consensus.cc:3037] T 907cfb9438c741f7b4a6f398eae8a1a0 P e8a250514fe044ba9bf099e83c275a99 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:38.484097 31007 raft_consensus.cc:2454] T 907cfb9438c741f7b4a6f398eae8a1a0 P cff21cb0730e495f9e43bbd3a4078be6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07349c4d8c124d50b4ce4a4944e66c0b in term 1.
I20260811 11:45:38.484097 30835 raft_consensus.cc:2454] T 907cfb9438c741f7b4a6f398eae8a1a0 P e8a250514fe044ba9bf099e83c275a99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07349c4d8c124d50b4ce4a4944e66c0b in term 1.
I20260811 11:45:38.484365 31094 leader_election.cc:302] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07349c4d8c124d50b4ce4a4944e66c0b, e8a250514fe044ba9bf099e83c275a99; no voters:
I20260811 11:45:38.484619 31286 raft_consensus.cc:2781] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:38.484702 31286 raft_consensus.cc:686] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b [term 1 LEADER]: Becoming Leader. State: Replica: 07349c4d8c124d50b4ce4a4944e66c0b, State: Running, Role: LEADER
I20260811 11:45:38.484875 31286 consensus_queue.cc:237] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } }
I20260811 11:45:38.486753 30636 catalog_manager.cc:5495] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 07349c4d8c124d50b4ce4a4944e66c0b (127.20.244.67). New cstate: current_term: 1 leader_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07349c4d8c124d50b4ce4a4944e66c0b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43989 } health_report { overall_health: HEALTHY } } }
I20260811 11:45:38.506016 31273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:38.502743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37038 (local address 127.20.244.67:43989)
0811 11:45:38.502864 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:38.502867 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:38.502880 (+ 13us) server_negotiation.cc:407] Connection header received
0811 11:45:38.502957 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:38.502959 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:38.502996 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:38.503048 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:45:38.503321 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.503822 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.504986 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:38.505199 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:38.505289 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:38.505544 (+ 255us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:45:38.505611 (+ 67us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:45:38.505666 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:38.505775 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 11:45:38.505833 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 11:45:38.512169 31007 raft_consensus.cc:1261] T 907cfb9438c741f7b4a6f398eae8a1a0 P cff21cb0730e495f9e43bbd3a4078be6 [term 1 FOLLOWER]: Refusing update from remote peer 07349c4d8c124d50b4ce4a4944e66c0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:38.512189 30835 raft_consensus.cc:1261] T 907cfb9438c741f7b4a6f398eae8a1a0 P e8a250514fe044ba9bf099e83c275a99 [term 1 FOLLOWER]: Refusing update from remote peer 07349c4d8c124d50b4ce4a4944e66c0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:45:38.512598 31286 consensus_queue.cc:1035] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8a250514fe044ba9bf099e83c275a99" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:38.512832 31317 consensus_queue.cc:1035] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cff21cb0730e495f9e43bbd3a4078be6" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:45:38.547789 30636 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39320:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:38.547986 30636 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39320:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:45:38.550073 30636 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6f7360d9660b4fecb7985f08d5bccd90: Sending DeleteTablet for 3 replicas of tablet 907cfb9438c741f7b4a6f398eae8a1a0
I20260811 11:45:38.550678 31156 tablet_service.cc:1514] Processing DeleteTablet for tablet 907cfb9438c741f7b4a6f398eae8a1a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:38 UTC) from {username='oryx', principal='oryx/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:37018
I20260811 11:45:38.550843 31366 tablet_replica.cc:330] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b: stopping tablet replica
I20260811 11:45:38.550822 30809 tablet_service.cc:1514] Processing DeleteTablet for tablet 907cfb9438c741f7b4a6f398eae8a1a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:38 UTC) from {username='oryx', principal='oryx/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:47568
I20260811 11:45:38.550961 31366 raft_consensus.cc:2229] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:45:38.551070 31368 tablet_replica.cc:330] T 907cfb9438c741f7b4a6f398eae8a1a0 P e8a250514fe044ba9bf099e83c275a99: stopping tablet replica
I20260811 11:45:38.551174 31366 raft_consensus.cc:2258] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:38.551227 31368 raft_consensus.cc:2229] T 907cfb9438c741f7b4a6f398eae8a1a0 P e8a250514fe044ba9bf099e83c275a99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:38.551352 31368 raft_consensus.cc:2258] T 907cfb9438c741f7b4a6f398eae8a1a0 P e8a250514fe044ba9bf099e83c275a99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:38.551342 30986 tablet_service.cc:1514] Processing DeleteTablet for tablet 907cfb9438c741f7b4a6f398eae8a1a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:45:38 UTC) from {username='oryx', principal='oryx/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:43376
I20260811 11:45:38.551630 31369 tablet_replica.cc:330] T 907cfb9438c741f7b4a6f398eae8a1a0 P cff21cb0730e495f9e43bbd3a4078be6: stopping tablet replica
I20260811 11:45:38.551766 31369 raft_consensus.cc:2229] T 907cfb9438c741f7b4a6f398eae8a1a0 P cff21cb0730e495f9e43bbd3a4078be6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:45:38.551899 31369 raft_consensus.cc:2258] T 907cfb9438c741f7b4a6f398eae8a1a0 P cff21cb0730e495f9e43bbd3a4078be6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:45:38.551980 31366 ts_tablet_manager.cc:1905] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:38.552634 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 30721
I20260811 11:45:38.553030 31368 ts_tablet_manager.cc:1905] T 907cfb9438c741f7b4a6f398eae8a1a0 P e8a250514fe044ba9bf099e83c275a99: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:38.554207 31366 ts_tablet_manager.cc:1918] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:45:38.554267 31366 log.cc:1196] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/907cfb9438c741f7b4a6f398eae8a1a0
I20260811 11:45:38.554472 31366 ts_tablet_manager.cc:1939] T 907cfb9438c741f7b4a6f398eae8a1a0 P 07349c4d8c124d50b4ce4a4944e66c0b: Deleting consensus metadata
I20260811 11:45:38.557060 30622 catalog_manager.cc:4841] TS 07349c4d8c124d50b4ce4a4944e66c0b (127.20.244.67:43989): tablet 907cfb9438c741f7b4a6f398eae8a1a0 (table test-table [id=3984fac9441045b8a970e622089cfedc]) successfully deleted
I20260811 11:45:38.559803 31369 ts_tablet_manager.cc:1905] T 907cfb9438c741f7b4a6f398eae8a1a0 P cff21cb0730e495f9e43bbd3a4078be6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:45:38.563026 31369 ts_tablet_manager.cc:1918] T 907cfb9438c741f7b4a6f398eae8a1a0 P cff21cb0730e495f9e43bbd3a4078be6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:45:38.563135 31369 log.cc:1196] T 907cfb9438c741f7b4a6f398eae8a1a0 P cff21cb0730e495f9e43bbd3a4078be6: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/907cfb9438c741f7b4a6f398eae8a1a0
I20260811 11:45:38.563432 31369 ts_tablet_manager.cc:1939] T 907cfb9438c741f7b4a6f398eae8a1a0 P cff21cb0730e495f9e43bbd3a4078be6: Deleting consensus metadata
I20260811 11:45:38.564240 30620 catalog_manager.cc:4841] TS cff21cb0730e495f9e43bbd3a4078be6 (127.20.244.66:38853): tablet 907cfb9438c741f7b4a6f398eae8a1a0 (table test-table [id=3984fac9441045b8a970e622089cfedc]) successfully deleted
W20260811 11:45:38.565838 30620 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.244.65:46039 (error 108)
I20260811 11:45:38.565960 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 30906
I20260811 11:45:38.570056 31414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:38.569526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:46039 (local address 127.0.0.1:47586)
0811 11:45:38.569906 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:38.569972 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.65:46039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":70,"threads_started":1}
W20260811 11:45:38.570317 30620 catalog_manager.cc:4584] TS e8a250514fe044ba9bf099e83c275a99 (127.20.244.65:46039): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 907cfb9438c741f7b4a6f398eae8a1a0: Network error: Client connection negotiation failed: client connection to 127.20.244.65:46039: connect: Connection refused (error 111)
I20260811 11:45:38.575994 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 31077
I20260811 11:45:38.585963 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 30602
2026-08-11T11:45:38Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3348 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:45:38 dist-test-slave-vkjp krb5kdc[31417](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:45:38 dist-test-slave-vkjp krb5kdc[31417](info): set up 2 sockets
Aug 11 11:45:38 dist-test-slave-vkjp krb5kdc[31417](info): commencing operation
krb5kdc: starting...
W20260811 11:45:39.726100 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:45:39 dist-test-slave-vkjp krb5kdc[31417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448739, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:45:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:45:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:45:39.854251 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:40307
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:33411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:40307
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:39.970448 31431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:39.970723 31431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:39.970775 31431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:39.974768 31431 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:39.974828 31431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:39.974850 31431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:39.974903 31431 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:39.974942 31431 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:45:39.980198 31431 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:33411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:40307
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:40307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:39.981266 31431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:39.982331 31431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:45:39.991101 31431 server_base.cc:1034] running on GCE node
W20260811 11:45:39.991127 31440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:39.991135 31444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:39.991051 31439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:39.991904 31431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:39.993052 31431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:39.994239 31431 hybrid_clock.cc:648] HybridClock initialized: now 1786448739994215 us; error 38 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T11:45:40Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1412 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:45:40 dist-test-slave-vkjp krb5kdc[31449](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:45:40 dist-test-slave-vkjp krb5kdc[31449](info): set up 2 sockets
Aug 11 11:45:40 dist-test-slave-vkjp krb5kdc[31449](info): commencing operation
krb5kdc: starting...
W20260811 11:45:41.223201 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.198s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:45:41 dist-test-slave-vkjp krb5kdc[31449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448741, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:45:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:45:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:45:41.355422 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:39323
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:45987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:39323
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:41.467270 31465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:41.467564 31465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:41.467638 31465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:41.471606 31465 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:41.471692 31465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:41.471729 31465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:41.471766 31465 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:41.471798 31465 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:45:41.477059 31465 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:45987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:39323
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:39323
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:41.478111 31465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:41.479142 31465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:41.487920 31476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:41.487926 31473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:41.487910 31474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:41.488024 31465 server_base.cc:1034] running on GCE node
I20260811 11:45:41.488674 31465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:41.489763 31465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:41.490957 31465 hybrid_clock.cc:648] HybridClock initialized: now 1786448741490921 us; error 46 us; skew 500 ppm
Aug 11 11:45:41 dist-test-slave-vkjp krb5kdc[31449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448741, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:41.493712 31465 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:45:41.494546 31465 webserver.cc:460] Webserver started at http://127.20.244.126:43665/ using document root <none> and password file <none>
I20260811 11:45:41.495151 31465 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:41.495242 31465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:41.495472 31465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:41.497445 31465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "4053a0e2c0b94525bccf4a52662d0597"
format_stamp: "Formatted at 2026-08-11 11:45:41 on dist-test-slave-vkjp"
server_key: "1cc256ad917b013af40ff2306919c68d"
server_key_iv: "3a0945fcd26f4e03401963352e318209"
server_key_version: "encryptionkey@0"
I20260811 11:45:41.498014 31465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "4053a0e2c0b94525bccf4a52662d0597"
format_stamp: "Formatted at 2026-08-11 11:45:41 on dist-test-slave-vkjp"
server_key: "1cc256ad917b013af40ff2306919c68d"
server_key_iv: "3a0945fcd26f4e03401963352e318209"
server_key_version: "encryptionkey@0"
I20260811 11:45:41.501600 31465 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260811 11:45:41.503901 31484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:41.505065 31465 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:45:41.505203 31465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "4053a0e2c0b94525bccf4a52662d0597"
format_stamp: "Formatted at 2026-08-11 11:45:41 on dist-test-slave-vkjp"
server_key: "1cc256ad917b013af40ff2306919c68d"
server_key_iv: "3a0945fcd26f4e03401963352e318209"
server_key_version: "encryptionkey@0"
I20260811 11:45:41.505313 31465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:41.524209 31465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:41.527334 31465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:41.527542 31465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:41.534731 31465 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:39323
I20260811 11:45:41.534813 31547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:39323 every 8 connection(s)
I20260811 11:45:41.535784 31465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:45:41.538543 31549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:41.542687 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 31465
I20260811 11:45:41.542863 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:45:41.543208 21457 external_mini_cluster.cc:1428] Setting key 36e87c87bb512b10de25d81a4333eca7
I20260811 11:45:41.544147 31549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597: Bootstrap starting.
I20260811 11:45:41.546340 31549 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:41.547317 31549 log.cc:824] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:41.549362 31549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597: No bootstrap required, opened a new log
Aug 11 11:45:41 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448741, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:41.553908 31549 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4053a0e2c0b94525bccf4a52662d0597" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39323 } }
I20260811 11:45:41.554200 31549 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:41.554342 31549 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4053a0e2c0b94525bccf4a52662d0597, State: Initialized, Role: FOLLOWER
I20260811 11:45:41.554829 31549 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4053a0e2c0b94525bccf4a52662d0597" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39323 } }
I20260811 11:45:41.554960 31549 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:45:41.555043 31549 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:45:41.555178 31549 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:41.556113 31549 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4053a0e2c0b94525bccf4a52662d0597" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39323 } }
I20260811 11:45:41.556468 31549 leader_election.cc:302] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4053a0e2c0b94525bccf4a52662d0597; no voters:
I20260811 11:45:41.556838 31549 leader_election.cc:288] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:45:41.556958 31555 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:41.557188 31555 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [term 1 LEADER]: Becoming Leader. State: Replica: 4053a0e2c0b94525bccf4a52662d0597, State: Running, Role: LEADER
I20260811 11:45:41.557672 31555 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4053a0e2c0b94525bccf4a52662d0597" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39323 } }
I20260811 11:45:41.558190 31549 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:45:41.558250 31553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:41.544590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37020 (local address 127.20.244.126:39323)
0811 11:45:41.544998 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:41.545019 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:41.545054 (+ 35us) server_negotiation.cc:407] Connection header received
0811 11:45:41.545680 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:41.545697 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:41.546005 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:41.546270 (+ 265us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:41.547273 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:41.548601 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:41.549746 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:41.550206 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:41.550336 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:41.553103 (+ 2767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:41.553110 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:41.553126 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:41.553157 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:41.555273 (+ 2116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:41.555701 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:41.555708 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:41.555713 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:41.555843 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:41.556132 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:41.556136 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:41.556138 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:41.556627 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:41.556913 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:41.557119 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 11:45:41.557419 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":141,"threads_started":1}
I20260811 11:45:41.558871 31555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4053a0e2c0b94525bccf4a52662d0597" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4053a0e2c0b94525bccf4a52662d0597" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39323 } } }
I20260811 11:45:41.559017 31555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:41.559248 31555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4053a0e2c0b94525bccf4a52662d0597. Latest consensus state: current_term: 1 leader_uuid: "4053a0e2c0b94525bccf4a52662d0597" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4053a0e2c0b94525bccf4a52662d0597" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39323 } } }
I20260811 11:45:41.559423 31555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:41.561108 31565 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:45:41.563580 31565 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:45:41.569190 31565 catalog_manager.cc:1347] Generated new cluster ID: f00da2b215414cd0b788af8f5d49adfe
I20260811 11:45:41.569260 31565 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:45:41.576229 31565 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:45:41.577085 31565 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:45:41.582248 31565 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597: Generated new TSK 0
I20260811 11:45:41.582980 31565 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.244.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
I20260811 11:45:41.623700 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:39323
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:45987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:41.738581 31582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:41.738819 31582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:41.738862 31582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:41.742909 31582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:41.742961 31582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:41.743052 31582 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:45:41.748132 31582 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:45987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:39323
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31582
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:41.749087 31582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:41.750074 31582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:41.759825 31590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:41.759847 31587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:41.759825 31588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:41.760181 31582 server_base.cc:1034] running on GCE node
I20260811 11:45:41.760721 31582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:41.761348 31582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:41.762511 31582 hybrid_clock.cc:648] HybridClock initialized: now 1786448741762499 us; error 25 us; skew 500 ppm
Aug 11 11:45:41 dist-test-slave-vkjp krb5kdc[31449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448741, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:41.765364 31582 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:45:41.766197 31582 webserver.cc:460] Webserver started at http://127.20.244.65:44087/ using document root <none> and password file <none>
I20260811 11:45:41.766736 31582 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:41.766793 31582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:41.767035 31582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:41.769052 31582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "d293ed1e501a467db642a63c8f0c980e"
format_stamp: "Formatted at 2026-08-11 11:45:41 on dist-test-slave-vkjp"
server_key: "866acd306db21c37020dbda7f8eb407a"
server_key_iv: "13a888c8d7649148ea3af9f291aea604"
server_key_version: "encryptionkey@0"
I20260811 11:45:41.769626 31582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "d293ed1e501a467db642a63c8f0c980e"
format_stamp: "Formatted at 2026-08-11 11:45:41 on dist-test-slave-vkjp"
server_key: "866acd306db21c37020dbda7f8eb407a"
server_key_iv: "13a888c8d7649148ea3af9f291aea604"
server_key_version: "encryptionkey@0"
I20260811 11:45:41.773345 31582 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 11:45:41.775779 31597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:41.777004 31582 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 11:45:41.777137 31582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "d293ed1e501a467db642a63c8f0c980e"
format_stamp: "Formatted at 2026-08-11 11:45:41 on dist-test-slave-vkjp"
server_key: "866acd306db21c37020dbda7f8eb407a"
server_key_iv: "13a888c8d7649148ea3af9f291aea604"
server_key_version: "encryptionkey@0"
I20260811 11:45:41.777247 31582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:41.805686 31582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:41.808766 31582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:41.808977 31582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:41.809618 31582 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:41.810446 31582 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:41.810608 31582 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:41.810727 31582 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:41.810789 31582 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:41.819764 31582 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:39951
I20260811 11:45:41.819794 31731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:39951 every 8 connection(s)
I20260811 11:45:41.820636 31582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:45:41.821574 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 31582
I20260811 11:45:41.821702 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:45:41.822026 21457 external_mini_cluster.cc:1428] Setting key ac40e71a4798361d2827978dd2c16a50
Aug 11 11:45:41 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448741, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.244.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.66@KRBTEST.COM" created.
I20260811 11:45:41.836615 31553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:41.822585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:39855 (local address 127.20.244.126:39323)
0811 11:45:41.822740 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:41.822744 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:41.824155 (+ 1411us) server_negotiation.cc:407] Connection header received
0811 11:45:41.825744 (+ 1589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:41.825749 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:41.825815 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:41.825901 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:41.827340 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:41.828192 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:41.829659 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:41.830120 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:41.830254 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:41.833056 (+ 2802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:41.833060 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:41.833063 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:41.833090 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:41.834501 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:41.834997 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:41.834999 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:41.835000 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:41.835075 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:41.835456 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:41.835458 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:41.835459 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:41.835715 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:41.835804 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:41.836295 (+ 491us) server_negotiation.cc:299] Negotiation successful
0811 11:45:41.836436 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 11:45:41.837363 31734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:41.823015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.65:39855)
0811 11:45:41.823960 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:41.824022 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:41.825471 (+ 1449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:41.826140 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:41.826154 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:41.826600 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:41.827166 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:41.827191 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:41.828357 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:41.828360 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:41.829520 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:41.829532 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:41.830315 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:41.830318 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:41.830465 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:41.831182 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:41.831197 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:41.832884 (+ 1687us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:41.834615 (+ 1731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:41.834621 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:41.834632 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:41.834884 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:41.835224 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:41.835226 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:41.835227 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:41.835359 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:41.835808 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:41.835813 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:41.836044 (+ 231us) client_negotiation.cc:769] Sending connection context
0811 11:45:41.836232 (+ 188us) client_negotiation.cc:240] Negotiation successful
0811 11:45:41.836548 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":134,"threads_started":1}
I20260811 11:45:41.839123 31732 heartbeater.cc:347] Connected to a master server at 127.20.244.126:39323
I20260811 11:45:41.839372 31732 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:41.839856 31732 heartbeater.cc:511] Master 127.20.244.126:39323 requested a full tablet report, sending...
I20260811 11:45:41.841374 31505 ts_manager.cc:194] Registered new tserver with Master: d293ed1e501a467db642a63c8f0c980e (127.20.244.65:39951)
I20260811 11:45:41.842486 31505 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:39855
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
I20260811 11:45:41.854653 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:39323
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:45987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:41.968350 31739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:41.968676 31739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:41.968760 31739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:41.973191 31739 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:41.973281 31739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:41.973480 31739 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:45:41.978734 31739 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:45987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:39323
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31739
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:41.979914 31739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:41.981088 31739 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:41.991031 31746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:41.991114 31739 server_base.cc:1034] running on GCE node
W20260811 11:45:41.991252 31747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:41.991466 31750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:41.991981 31739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:41.992704 31739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:41.993894 31739 hybrid_clock.cc:648] HybridClock initialized: now 1786448741993874 us; error 33 us; skew 500 ppm
Aug 11 11:45:41 dist-test-slave-vkjp krb5kdc[31449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448741, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:41.996794 31739 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:45:41.997709 31739 webserver.cc:460] Webserver started at http://127.20.244.66:34691/ using document root <none> and password file <none>
I20260811 11:45:41.998312 31739 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:41.998375 31739 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:41.998598 31739 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:42.000854 31739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "e4bbfcda3cef469fa27cde36832ef2bf"
format_stamp: "Formatted at 2026-08-11 11:45:41 on dist-test-slave-vkjp"
server_key: "4870533cab12072ad89174508daccdff"
server_key_iv: "2434c26200b7c66e6c3d597bd317abc5"
server_key_version: "encryptionkey@0"
I20260811 11:45:42.001616 31739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "e4bbfcda3cef469fa27cde36832ef2bf"
format_stamp: "Formatted at 2026-08-11 11:45:41 on dist-test-slave-vkjp"
server_key: "4870533cab12072ad89174508daccdff"
server_key_iv: "2434c26200b7c66e6c3d597bd317abc5"
server_key_version: "encryptionkey@0"
I20260811 11:45:42.005851 31739 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260811 11:45:42.008566 31757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:42.010069 31739 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 11:45:42.010206 31739 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "e4bbfcda3cef469fa27cde36832ef2bf"
format_stamp: "Formatted at 2026-08-11 11:45:41 on dist-test-slave-vkjp"
server_key: "4870533cab12072ad89174508daccdff"
server_key_iv: "2434c26200b7c66e6c3d597bd317abc5"
server_key_version: "encryptionkey@0"
I20260811 11:45:42.010367 31739 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:42.046844 31739 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:42.050153 31739 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:42.050390 31739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:42.051043 31739 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:42.051980 31739 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:42.052054 31739 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:42.052122 31739 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:42.052172 31739 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:42.062139 31739 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:44973
I20260811 11:45:42.062160 31895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:44973 every 8 connection(s)
I20260811 11:45:42.063074 31739 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:45:42.071745 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 31739
I20260811 11:45:42.071899 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:45:42.072191 21457 external_mini_cluster.cc:1428] Setting key 625a791681382d00f2bb5e7aa786e7d5
Aug 11 11:45:42 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448741, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:42.077870 31553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:42.065010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:58909 (local address 127.20.244.126:39323)
0811 11:45:42.065154 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:42.065158 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:42.066134 (+ 976us) server_negotiation.cc:407] Connection header received
0811 11:45:42.067451 (+ 1317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:42.067455 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:42.067515 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:42.067626 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:42.068825 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:42.069356 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:42.070489 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:42.070712 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:42.070834 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:42.073656 (+ 2822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:42.073661 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:42.073664 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:42.073693 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:42.075501 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:42.076105 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:42.076114 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:42.076116 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:42.076209 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:42.076624 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:42.076630 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:42.076632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:42.076851 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:42.076978 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:42.077522 (+ 544us) server_negotiation.cc:299] Negotiation successful
0811 11:45:42.077669 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 11:45:42.078871 31898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:42.065310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.66:58909)
0811 11:45:42.065974 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:42.066017 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:42.067022 (+ 1005us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:42.067796 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:42.067803 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:42.068184 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:42.068661 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:42.068674 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:42.069483 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:42.069488 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:42.070363 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:42.070371 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:42.070866 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:42.070870 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:42.071045 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:42.071723 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:42.071740 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:42.073512 (+ 1772us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:42.075638 (+ 2126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:42.075644 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:42.075656 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:42.075945 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:42.076345 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:42.076353 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:42.076355 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:42.076508 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:42.076975 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:42.076982 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:42.077254 (+ 272us) client_negotiation.cc:769] Sending connection context
0811 11:45:42.077470 (+ 216us) client_negotiation.cc:240] Negotiation successful
0811 11:45:42.077830 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":113,"threads_started":1}
I20260811 11:45:42.080339 31896 heartbeater.cc:347] Connected to a master server at 127.20.244.126:39323
I20260811 11:45:42.080628 31896 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:42.081218 31896 heartbeater.cc:511] Master 127.20.244.126:39323 requested a full tablet report, sending...
I20260811 11:45:42.082473 31505 ts_manager.cc:194] Registered new tserver with Master: e4bbfcda3cef469fa27cde36832ef2bf (127.20.244.66:44973)
WARNING: no policy specified for kudu/127.20.244.67@KRBTEST.COM; defaulting to no policy
I20260811 11:45:42.083354 31505 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:58909
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
I20260811 11:45:42.102630 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:39323
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:45987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:42.214954 31901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:42.215270 31901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:42.215346 31901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:42.219304 31901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:42.219390 31901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:42.219524 31901 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:45:42.224764 31901 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:45987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:39323
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31901
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:42.225867 31901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:42.226898 31901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:42.236544 31911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:42.236531 31907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:42.236549 31906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:42.236680 31901 server_base.cc:1034] running on GCE node
I20260811 11:45:42.237221 31901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:42.237890 31901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:42.239189 31901 hybrid_clock.cc:648] HybridClock initialized: now 1786448742239162 us; error 26 us; skew 500 ppm
Aug 11 11:45:42 dist-test-slave-vkjp krb5kdc[31449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448742, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:42.242118 31901 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:45:42.243137 31901 webserver.cc:460] Webserver started at http://127.20.244.67:33283/ using document root <none> and password file <none>
I20260811 11:45:42.243714 31901 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:42.243778 31901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:42.243954 31901 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:42.246124 31901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "795e46e0c0be48668b659261e837b4c9"
format_stamp: "Formatted at 2026-08-11 11:45:42 on dist-test-slave-vkjp"
server_key: "e44f97cec6d2da5cb5f0716762e65e24"
server_key_iv: "5701bd3ce35d3bc746c8f5c0cacdbea5"
server_key_version: "encryptionkey@0"
I20260811 11:45:42.246690 31901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "795e46e0c0be48668b659261e837b4c9"
format_stamp: "Formatted at 2026-08-11 11:45:42 on dist-test-slave-vkjp"
server_key: "e44f97cec6d2da5cb5f0716762e65e24"
server_key_iv: "5701bd3ce35d3bc746c8f5c0cacdbea5"
server_key_version: "encryptionkey@0"
I20260811 11:45:42.250972 31901 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260811 11:45:42.259184 31918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:42.260720 31901 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.003s sys 0.000s
I20260811 11:45:42.260840 31901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "795e46e0c0be48668b659261e837b4c9"
format_stamp: "Formatted at 2026-08-11 11:45:42 on dist-test-slave-vkjp"
server_key: "e44f97cec6d2da5cb5f0716762e65e24"
server_key_iv: "5701bd3ce35d3bc746c8f5c0cacdbea5"
server_key_version: "encryptionkey@0"
I20260811 11:45:42.261009 31901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:42.290139 31901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:42.293413 31901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:42.293651 31901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:42.294360 31901 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:42.295352 31901 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:42.295405 31901 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:42.295477 31901 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:42.295521 31901 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:42.305276 31901 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:38397
I20260811 11:45:42.305347 32056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:38397 every 8 connection(s)
I20260811 11:45:42.306298 31901 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:45:42.310055 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 31901
I20260811 11:45:42.310204 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:45:42.310508 21457 external_mini_cluster.cc:1428] Setting key ce65bde4ecf8f0769fda5b4d48cc740e
Aug 11 11:45:42 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448742, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:45:42.321022 31553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:42.308233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:36063 (local address 127.20.244.126:39323)
0811 11:45:42.308481 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:42.308491 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:42.309668 (+ 1177us) server_negotiation.cc:407] Connection header received
0811 11:45:42.310857 (+ 1189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:42.310861 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:42.310910 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:42.310985 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:42.312676 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:42.313285 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:42.314678 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:42.314939 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:42.315021 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:42.317603 (+ 2582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:42.317606 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:42.317607 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:42.317632 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:42.319171 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:42.319636 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:42.319638 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:42.319639 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:42.319712 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:42.320023 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:42.320025 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:42.320026 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:42.320198 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:42.320271 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:42.320794 (+ 523us) server_negotiation.cc:299] Negotiation successful
0811 11:45:42.320890 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151}
I20260811 11:45:42.321853 32059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:42.308748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.67:36063)
0811 11:45:42.309517 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:42.309561 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:42.310626 (+ 1065us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:42.311226 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:42.311234 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:42.311787 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:42.312511 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:42.312533 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:42.313475 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:42.313487 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:42.314543 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:42.314558 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:42.315117 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:42.315125 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:42.315338 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:42.315887 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:42.315904 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:42.317449 (+ 1545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:42.319270 (+ 1821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:42.319275 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:42.319293 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:42.319549 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:42.319797 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:45:42.319800 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:45:42.319801 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:45:42.319935 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:45:42.320323 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:42.320328 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:42.320549 (+ 221us) client_negotiation.cc:769] Sending connection context
0811 11:45:42.320729 (+ 180us) client_negotiation.cc:240] Negotiation successful
0811 11:45:42.320977 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":119,"threads_started":1}
I20260811 11:45:42.322993 32057 heartbeater.cc:347] Connected to a master server at 127.20.244.126:39323
I20260811 11:45:42.323298 32057 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:42.323876 32057 heartbeater.cc:511] Master 127.20.244.126:39323 requested a full tablet report, sending...
I20260811 11:45:42.324956 31505 ts_manager.cc:194] Registered new tserver with Master: 795e46e0c0be48668b659261e837b4c9 (127.20.244.67:38397)
I20260811 11:45:42.325555 31505 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:36063
I20260811 11:45:42.336436 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.20.244.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.244.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.244.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.65.keytab.
Entry for principal oryx/127.20.244.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.65.keytab.
WARNING: no policy specified for oryx/127.20.244.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.244.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.244.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.66.keytab.
Entry for principal oryx/127.20.244.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.66.keytab.
WARNING: no policy specified for oryx/127.20.244.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.244.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.244.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.67.keytab.
Entry for principal oryx/127.20.244.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.67.keytab.
I20260811 11:45:42.418334 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 31582
I20260811 11:45:42.428975 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 31739
I20260811 11:45:42.436219 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 31901
I20260811 11:45:42.444176 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 31465
I20260811 11:45:42.453212 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:39323
--webserver_interface=127.20.244.126
--webserver_port=43665
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:45987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:39323
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:45:42.584281 32067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:42.584645 32067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:42.584719 32067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:42.588792 32067 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:42.588848 32067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:42.588868 32067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:42.588886 32067 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:42.588900 32067 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:45:42.594218 32067 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:45987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:39323
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:39323
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=43665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32067
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:42.595234 32067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:42.596228 32067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:42.604887 32074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:42.604892 32073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:42.604898 32076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:42.605195 32067 server_base.cc:1034] running on GCE node
I20260811 11:45:42.605859 32067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:42.607043 32067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:42.608274 32067 hybrid_clock.cc:648] HybridClock initialized: now 1786448742608255 us; error 25 us; skew 500 ppm
Aug 11 11:45:42 dist-test-slave-vkjp krb5kdc[31449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448742, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:42.611117 32067 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:45:42.612001 32067 webserver.cc:460] Webserver started at http://127.20.244.126:43665/ using document root <none> and password file <none>
I20260811 11:45:42.612555 32067 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:42.612675 32067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:42.616614 32067 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 11:45:42.618944 32084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:42.620479 32067 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 11:45:42.620633 32067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "4053a0e2c0b94525bccf4a52662d0597"
format_stamp: "Formatted at 2026-08-11 11:45:41 on dist-test-slave-vkjp"
server_key: "1cc256ad917b013af40ff2306919c68d"
server_key_iv: "3a0945fcd26f4e03401963352e318209"
server_key_version: "encryptionkey@0"
I20260811 11:45:42.621212 32067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:42.657815 32067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:42.661006 32067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:42.661221 32067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:42.669205 32067 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:39323
I20260811 11:45:42.669286 32145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:39323 every 8 connection(s)
I20260811 11:45:42.670303 32067 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:45:42.670586 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 32067
I20260811 11:45:42.671164 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:39951
--local_ip_for_outbound_sockets=127.20.244.65
--tserver_master_addrs=127.20.244.126:39323
--webserver_port=44087
--webserver_interface=127.20.244.65
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:45987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.244.65
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:45:42.674818 32146 sys_catalog.cc:263] Verifying existing consensus state
I20260811 11:45:42.676525 32146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597: Bootstrap starting.
I20260811 11:45:42.693177 32146 log.cc:824] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:42.699703 32146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:45:42.700075 32146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597: Bootstrap complete.
I20260811 11:45:42.704439 32146 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4053a0e2c0b94525bccf4a52662d0597" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39323 } }
I20260811 11:45:42.704879 32146 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4053a0e2c0b94525bccf4a52662d0597, State: Initialized, Role: FOLLOWER
I20260811 11:45:42.705408 32146 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4053a0e2c0b94525bccf4a52662d0597" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39323 } }
I20260811 11:45:42.705557 32146 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:45:42.705648 32146 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:45:42.705775 32146 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [term 1 FOLLOWER]: Advancing to term 2
I20260811 11:45:42.707796 32146 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4053a0e2c0b94525bccf4a52662d0597" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39323 } }
I20260811 11:45:42.708123 32146 leader_election.cc:302] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4053a0e2c0b94525bccf4a52662d0597; no voters:
I20260811 11:45:42.708469 32146 leader_election.cc:288] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 11:45:42.708561 32151 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 11:45:42.708811 32151 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [term 2 LEADER]: Becoming Leader. State: Replica: 4053a0e2c0b94525bccf4a52662d0597, State: Running, Role: LEADER
I20260811 11:45:42.709165 32151 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4053a0e2c0b94525bccf4a52662d0597" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39323 } }
I20260811 11:45:42.709736 32146 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:45:42.710590 32154 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4053a0e2c0b94525bccf4a52662d0597. Latest consensus state: current_term: 2 leader_uuid: "4053a0e2c0b94525bccf4a52662d0597" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4053a0e2c0b94525bccf4a52662d0597" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39323 } } }
I20260811 11:45:42.710644 32152 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4053a0e2c0b94525bccf4a52662d0597" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4053a0e2c0b94525bccf4a52662d0597" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39323 } } }
I20260811 11:45:42.710798 32152 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:42.710728 32154 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:42.711211 32164 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:45:42.714478 32164 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:45:42.715226 32164 catalog_manager.cc:1259] Loaded cluster ID: f00da2b215414cd0b788af8f5d49adfe
I20260811 11:45:42.715308 32164 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:45:42.717077 32164 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:45:42.717665 32164 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4053a0e2c0b94525bccf4a52662d0597: Loaded TSK: 0
I20260811 11:45:42.718611 32164 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 11:45:42.795225 32149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:42.795519 32149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:42.795593 32149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:42.799636 32149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:42.799714 32149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:42.799805 32149 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:45:42.804924 32149 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:45987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.65.keytab
--principal=oryx/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:39951
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=44087
--tserver_master_addrs=127.20.244.126:39323
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32149
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:42.805909 32149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:42.806887 32149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:42.817766 32179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:42.817817 32182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:42.818126 32149 server_base.cc:1034] running on GCE node
W20260811 11:45:42.818229 32180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:42.818668 32149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:42.819366 32149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:42.820559 32149 hybrid_clock.cc:648] HybridClock initialized: now 1786448742820527 us; error 45 us; skew 500 ppm
Aug 11 11:45:42 dist-test-slave-vkjp krb5kdc[31449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448742, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:42.828783 32149 init.cc:377] Logged in from keytab as oryx/127.20.244.65@KRBTEST.COM (short username oryx)
I20260811 11:45:42.829707 32149 webserver.cc:460] Webserver started at http://127.20.244.65:44087/ using document root <none> and password file <none>
I20260811 11:45:42.830267 32149 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:42.830343 32149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:42.834275 32149 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:42.836521 32191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:42.837829 32149 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 11:45:42.837972 32149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "d293ed1e501a467db642a63c8f0c980e"
format_stamp: "Formatted at 2026-08-11 11:45:41 on dist-test-slave-vkjp"
server_key: "866acd306db21c37020dbda7f8eb407a"
server_key_iv: "13a888c8d7649148ea3af9f291aea604"
server_key_version: "encryptionkey@0"
I20260811 11:45:42.838512 32149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:42.854099 32149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:42.857371 32149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:42.857586 32149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:42.858179 32149 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:42.859073 32149 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:42.859187 32149 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:42.859258 32149 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:42.859299 32149 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:42.868749 32149 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:39951
I20260811 11:45:42.868783 32325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:39951 every 8 connection(s)
I20260811 11:45:42.869755 32149 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:45:42.879145 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 32149
I20260811 11:45:42.879618 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:44973
--local_ip_for_outbound_sockets=127.20.244.66
--tserver_master_addrs=127.20.244.126:39323
--webserver_port=34691
--webserver_interface=127.20.244.66
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:45987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.244.66
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 11:45:42 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:42 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:42.882766 32330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:42.871947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.65:59925)
0811 11:45:42.872652 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:42.872703 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:42.873477 (+ 774us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:42.874506 (+ 1029us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:42.874513 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:42.874840 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:42.875388 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:42.875403 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:42.876633 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:42.876635 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:42.877481 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:42.877490 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:42.878184 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:42.878186 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:42.878316 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:42.878923 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:42.878939 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:42.881839 (+ 2900us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":142,"threads_started":1}
W20260811 11:45:42.882756 32329 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:42.871810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:59925 (local address 127.20.244.126:39323)
0811 11:45:42.872252 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:42.872268 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:42.872831 (+ 563us) server_negotiation.cc:407] Connection header received
0811 11:45:42.873833 (+ 1002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:42.873844 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:42.874117 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:42.874389 (+ 272us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:42.875542 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:42.876502 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:42.877590 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:42.878049 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:42.878167 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:42.882058 (+ 3891us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.65:59925: BlockingRecv error: recv got EOF from 127.20.244.65:59925 (error 108)
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":135,"threads_started":1}
W20260811 11:45:42.883410 32326 heartbeater.cc:644] Failed to heartbeat to 127.20.244.126:39323 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.244.126:39323: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Aug 11 11:45:42 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:42 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:42.889153 32330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:42.884013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.65:37499)
0811 11:45:42.884180 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:42.884193 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:42.884276 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:42.884591 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:42.884594 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:42.884765 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:42.884848 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:42.884860 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:42.885578 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:42.885583 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:42.886122 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:42.886130 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:42.886584 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:42.886588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:42.886679 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:42.887173 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:42.887193 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:42.888985 (+ 1792us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":100}
W20260811 11:45:42.889180 32329 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:42.883979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:37499 (local address 127.20.244.126:39323)
0811 11:45:42.884088 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:42.884091 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:42.884263 (+ 172us) server_negotiation.cc:407] Connection header received
0811 11:45:42.884379 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:42.884383 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:42.884466 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:42.884582 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:42.884968 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:42.885467 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:42.886246 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:42.886472 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:42.886583 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:42.889095 (+ 2512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.65:37499: BlockingRecv error: recv got EOF from 127.20.244.65:37499 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 11 11:45:42 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:42 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:42.894446 32330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:42.889774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.65:43983)
0811 11:45:42.889885 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:42.889900 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:42.889978 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:42.890225 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:42.890228 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:42.890380 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:42.890445 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:42.890449 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:42.891213 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:42.891217 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:42.891721 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:42.891729 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:42.892168 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:42.892172 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:42.892256 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:42.892697 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:42.892708 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:42.894311 (+ 1603us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 11:45:42.894531 32329 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:42.889892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:43983 (local address 127.20.244.126:39323)
0811 11:45:42.890038 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:42.890044 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:42.890058 (+ 14us) server_negotiation.cc:407] Connection header received
0811 11:45:42.890095 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:42.890097 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:42.890128 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:42.890209 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:42.890555 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:42.891030 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:42.891842 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:42.892059 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:42.892166 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:42.894420 (+ 2254us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.65:43983: BlockingRecv error: recv got EOF from 127.20.244.65:43983 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260811 11:45:42.894691 32326 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 11:45:42.999368 32331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:42.999629 32331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:42.999676 32331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:43.004375 32331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:43.004438 32331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:43.004503 32331 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:45:43.010553 32331 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:45987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.66.keytab
--principal=oryx/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:44973
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=34691
--tserver_master_addrs=127.20.244.126:39323
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32331
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:43.011816 32331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:43.012948 32331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:43.022910 32341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:43.022905 32339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:43.022905 32338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:43.023305 32331 server_base.cc:1034] running on GCE node
I20260811 11:45:43.023679 32331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:43.024397 32331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:43.025583 32331 hybrid_clock.cc:648] HybridClock initialized: now 1786448743025568 us; error 28 us; skew 500 ppm
Aug 11 11:45:43 dist-test-slave-vkjp krb5kdc[31449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448743, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:43.028481 32331 init.cc:377] Logged in from keytab as oryx/127.20.244.66@KRBTEST.COM (short username oryx)
I20260811 11:45:43.029261 32331 webserver.cc:460] Webserver started at http://127.20.244.66:34691/ using document root <none> and password file <none>
I20260811 11:45:43.029767 32331 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:43.029839 32331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:43.033617 32331 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 11:45:43.035764 32349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:43.036979 32331 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:43.037079 32331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "e4bbfcda3cef469fa27cde36832ef2bf"
format_stamp: "Formatted at 2026-08-11 11:45:41 on dist-test-slave-vkjp"
server_key: "4870533cab12072ad89174508daccdff"
server_key_iv: "2434c26200b7c66e6c3d597bd317abc5"
server_key_version: "encryptionkey@0"
I20260811 11:45:43.037582 32331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:43.048168 32331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:43.051383 32331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:43.051532 32331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:43.052030 32331 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:43.052804 32331 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:43.052850 32331 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:43.052888 32331 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:43.052904 32331 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:43.061647 32331 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:44973
I20260811 11:45:43.061672 32486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:44973 every 8 connection(s)
I20260811 11:45:43.062721 32331 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:45:43.068013 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 32331
I20260811 11:45:43.068550 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:38397
--local_ip_for_outbound_sockets=127.20.244.67
--tserver_master_addrs=127.20.244.126:39323
--webserver_port=33283
--webserver_interface=127.20.244.67
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:45987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.244.67
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 11:45:43 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:43 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 11:45:43.074793 32329 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:43.064626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:36245 (local address 127.20.244.126:39323)
0811 11:45:43.064767 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:43.064770 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:43.065796 (+ 1026us) server_negotiation.cc:407] Connection header received
0811 11:45:43.066631 (+ 835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:43.066634 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:43.066684 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:43.066759 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:43.068019 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.068847 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.070167 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.070451 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.070593 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:43.074689 (+ 4096us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.66:36245: BlockingRecv error: recv got EOF from 127.20.244.66:36245 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 11:45:43.075688 32489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:43.064984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.66:36245)
0811 11:45:43.065647 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:43.065686 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:43.066432 (+ 746us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:43.066922 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:43.066928 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:43.067395 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:43.067861 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:43.067875 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.068988 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.068992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:43.069994 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:43.070011 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.070634 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.070639 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:43.070845 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:43.071584 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:43.071604 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:43.074566 (+ 2962us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":110,"threads_started":1}
W20260811 11:45:43.076174 32487 heartbeater.cc:644] Failed to heartbeat to 127.20.244.126:39323 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.244.126:39323: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Aug 11 11:45:43 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:43 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:43.081614 32489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:43.076647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.66:60163)
0811 11:45:43.076756 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:43.076773 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:43.076872 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:43.077135 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:43.077138 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:43.077299 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:43.077386 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:43.077391 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.078110 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.078115 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:43.078653 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:43.078660 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.079139 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.079143 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:43.079241 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:43.079727 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:43.079739 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:43.081498 (+ 1759us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 11:45:43.081777 32329 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:43.076788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:60163 (local address 127.20.244.126:39323)
0811 11:45:43.076934 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:43.076940 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:43.076955 (+ 15us) server_negotiation.cc:407] Connection header received
0811 11:45:43.076999 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:43.077001 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:43.077035 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:43.077119 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:43.077502 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.078000 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.078787 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.079003 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.079132 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:43.081626 (+ 2494us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.66:60163: BlockingRecv error: recv got EOF from 127.20.244.66:60163 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 11 11:45:43 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:43 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:43.087330 32489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:43.082105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.66:47575)
0811 11:45:43.082246 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:43.082258 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:43.082322 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:43.082538 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:43.082541 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:43.082696 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:43.082789 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:43.082795 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.083588 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.083593 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:43.084436 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:43.084445 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.084878 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.084882 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:43.084964 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:43.085378 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:43.085392 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:43.087195 (+ 1803us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":86}
W20260811 11:45:43.087414 32329 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:43.082197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:47575 (local address 127.20.244.126:39323)
0811 11:45:43.082317 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:43.082320 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:43.082333 (+ 13us) server_negotiation.cc:407] Connection header received
0811 11:45:43.082400 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:43.082402 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:43.082435 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:43.082497 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:43.082892 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.083490 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.084547 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.084774 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.084851 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:43.087301 (+ 2450us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.66:47575: BlockingRecv error: recv got EOF from 127.20.244.66:47575 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260811 11:45:43.087513 32487 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 11:45:43.184633 32490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:43.184906 32490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:43.184979 32490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:43.188973 32490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:43.189060 32490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:43.189152 32490 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:45:43.194356 32490 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:45987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/krb5kdc/oryx_127.20.244.67.keytab
--principal=oryx/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:38397
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=33283
--tserver_master_addrs=127.20.244.126:39323
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:43.195454 32490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:43.196460 32490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:43.205976 32500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:43.205969 32495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:43.206030 32496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:43.206488 32490 server_base.cc:1034] running on GCE node
I20260811 11:45:43.206893 32490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:43.207579 32490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:43.208748 32490 hybrid_clock.cc:648] HybridClock initialized: now 1786448743208712 us; error 45 us; skew 500 ppm
Aug 11 11:45:43 dist-test-slave-vkjp krb5kdc[31449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448743, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:45:43.211913 32490 init.cc:377] Logged in from keytab as oryx/127.20.244.67@KRBTEST.COM (short username oryx)
I20260811 11:45:43.212843 32490 webserver.cc:460] Webserver started at http://127.20.244.67:33283/ using document root <none> and password file <none>
I20260811 11:45:43.213374 32490 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:43.213446 32490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:43.217344 32490 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 11:45:43.219465 32508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:43.220703 32490 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 11:45:43.220856 32490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "795e46e0c0be48668b659261e837b4c9"
format_stamp: "Formatted at 2026-08-11 11:45:42 on dist-test-slave-vkjp"
server_key: "e44f97cec6d2da5cb5f0716762e65e24"
server_key_iv: "5701bd3ce35d3bc746c8f5c0cacdbea5"
server_key_version: "encryptionkey@0"
I20260811 11:45:43.221400 32490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:43.246666 32490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:43.250092 32490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:43.250306 32490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:43.250931 32490 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:43.251808 32490 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:43.251854 32490 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:43.251942 32490 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:43.251979 32490 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:43.261073 32490 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:38397
I20260811 11:45:43.261097 32647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:38397 every 8 connection(s)
I20260811 11:45:43.262045 32490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:45:43.266084 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 32490
Aug 11 11:45:43 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:43 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 11:45:43.273450 32329 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:43.263892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:40859 (local address 127.20.244.126:39323)
0811 11:45:43.264030 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:43.264034 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:43.265028 (+ 994us) server_negotiation.cc:407] Connection header received
0811 11:45:43.265920 (+ 892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:43.265925 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:43.265989 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:43.266094 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:43.267659 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.268189 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.269503 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.269724 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.269903 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:43.273319 (+ 3416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.67:40859: BlockingRecv error: recv got EOF from 127.20.244.67:40859 (error 108)
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":55}
I20260811 11:45:43.273983 32650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:43.264250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.67:40859)
0811 11:45:43.264907 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:43.264945 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:43.265701 (+ 756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:43.266312 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:43.266319 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:43.266823 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:43.267503 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:43.267520 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.268322 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.268327 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:43.269374 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:43.269384 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.269883 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.269888 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:43.270069 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:43.270682 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:43.270706 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:43.273166 (+ 2460us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":110,"threads_started":1}
W20260811 11:45:43.274530 32648 heartbeater.cc:644] Failed to heartbeat to 127.20.244.126:39323 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.244.126:39323: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
I20260811 11:45:43.276369 32652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:43.267186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37028 (local address 127.20.244.126:39323)
0811 11:45:43.267444 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:43.267447 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:43.267457 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:45:43.267491 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:43.267493 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:43.267526 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:43.267631 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:43.268379 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.268930 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.269811 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.270083 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.270192 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:43.271763 (+ 1571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:43.271769 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:43.271783 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:45:43.271835 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:43.273878 (+ 2043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:43.274407 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:43.274413 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:43.274419 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:43.274573 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:45:43.274912 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:45:43.274915 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:45:43.274916 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:45:43.275414 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:43.275590 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:43.275972 (+ 382us) server_negotiation.cc:299] Negotiation successful
0811 11:45:43.276203 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":34,"server-negotiator.queue_time_us":182,"thread_start_us":127,"threads_started":1}
Aug 11 11:45:43 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:43 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:43.280356 32650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:43.274986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.67:60141)
0811 11:45:43.275127 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:43.275142 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:43.275216 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:43.275460 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:43.275463 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:43.275667 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:43.275799 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:43.275809 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.276708 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.276713 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:43.277252 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:43.277260 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.277715 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.277718 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:43.277822 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:43.278376 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:43.278395 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:43.280221 (+ 1826us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 11:45:43.280493 32329 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:43.275053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:60141 (local address 127.20.244.126:39323)
0811 11:45:43.275186 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:43.275190 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:43.275204 (+ 14us) server_negotiation.cc:407] Connection header received
0811 11:45:43.275276 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:43.275279 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:43.275326 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:43.275412 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:43.275910 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.276596 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.277377 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.277594 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.277701 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:43.280383 (+ 2682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.67:60141: BlockingRecv error: recv got EOF from 127.20.244.67:60141 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 11 11:45:43 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:43 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:43.285418 32650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:43.280920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.67:58559)
0811 11:45:43.281060 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:43.281079 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:43.281159 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:43.281363 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:43.281365 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:43.281483 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:43.281548 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:43.281552 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.282188 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.282191 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:43.282684 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:43.282692 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.283214 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.283217 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:43.283273 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:43.283668 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:43.283679 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:43.285333 (+ 1654us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 11:45:43.285614 32329 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:43.281018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:58559 (local address 127.20.244.126:39323)
0811 11:45:43.281156 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:43.281159 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:43.281171 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:45:43.281231 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:43.281233 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:43.281263 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:43.281324 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:43.281640 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.282094 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.282810 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.283030 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.283202 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:43.285494 (+ 2292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.67:58559: BlockingRecv error: recv got EOF from 127.20.244.67:58559 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260811 11:45:43.285638 32648 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 11:45:43 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:43 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:43.901594 32653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:43.895344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.65:32789)
0811 11:45:43.895681 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:43.895696 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:43.895803 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:43.896203 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:43.896207 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:43.896507 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:43.896645 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:43.896654 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.897711 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.897715 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:43.898362 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:43.898372 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.898847 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.898850 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:43.898922 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:43.899539 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:43.899565 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:43.901475 (+ 1910us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":90,"threads_started":1}
W20260811 11:45:43.901943 32654 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:43.895484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:32789 (local address 127.20.244.126:39323)
0811 11:45:43.895754 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:43.895757 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:43.895778 (+ 21us) server_negotiation.cc:407] Connection header received
0811 11:45:43.895951 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:43.895954 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:43.896004 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:43.896089 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:43.896811 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.897575 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.898485 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:43.898710 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:43.898806 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:43.901627 (+ 2821us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.65:32789: BlockingRecv error: recv got EOF from 127.20.244.65:32789 (error 108)
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":106,"threads_started":1}
Aug 11 11:45:44 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:44 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:44.094321 32655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:44.088094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.66:55261)
0811 11:45:44.088446 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:44.088465 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:44.088626 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:44.088967 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:44.088971 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:44.089198 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:44.089339 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:44.089348 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:44.090159 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:44.090166 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:44.090778 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:44.090787 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:44.091389 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:44.091394 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:44.091505 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:44.092126 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:44.092139 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:44.094129 (+ 1990us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":93,"threads_started":1}
W20260811 11:45:44.094414 32654 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:44.088258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:55261 (local address 127.20.244.126:39323)
0811 11:45:44.088442 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:44.088447 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:44.088561 (+ 114us) server_negotiation.cc:407] Connection header received
0811 11:45:44.088748 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:44.088754 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:44.088809 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:44.088945 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:44.089477 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:44.090034 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:44.090916 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:44.091262 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:44.091387 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:44.094286 (+ 2899us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.66:55261: BlockingRecv error: recv got EOF from 127.20.244.66:55261 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 11 11:45:44 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:44 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:44.291802 32658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:44.286367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.67:53061)
0811 11:45:44.286624 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:44.286637 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:44.286734 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:44.286976 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:44.286978 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:44.287232 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:44.287333 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:44.287338 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:44.288137 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:44.288140 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:44.288731 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:44.288741 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:44.289179 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:44.289181 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:44.289244 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:44.289809 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:44.289821 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:44.291674 (+ 1853us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":91,"threads_started":1}
W20260811 11:45:44.291976 32654 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:44.286396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:53061 (local address 127.20.244.126:39323)
0811 11:45:44.286569 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:44.286573 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:44.286744 (+ 171us) server_negotiation.cc:407] Connection header received
0811 11:45:44.286816 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:44.286819 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:44.286866 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:44.286942 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:44.287452 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:44.288003 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:44.288869 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:44.289082 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:44.289159 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:44.291810 (+ 2651us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.67:53061: BlockingRecv error: recv got EOF from 127.20.244.67:53061 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 11 11:45:44 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:44 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:44.908465 32659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:44.902540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.65:50503)
0811 11:45:44.902859 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:44.902873 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:44.902962 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:44.903287 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:44.903290 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:44.903478 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:44.903580 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:44.903586 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:44.904392 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:44.904395 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:44.904964 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:44.904973 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:44.905515 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:44.905518 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:44.905583 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:44.906191 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:44.906203 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:44.908234 (+ 2031us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":115,"threads_started":1}
W20260811 11:45:44.908524 32660 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:44.902618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:50503 (local address 127.20.244.126:39323)
0811 11:45:44.902917 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:44.902920 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:44.902936 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:45:44.903056 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:44.903058 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:44.903125 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:44.903217 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:44.903724 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:44.904273 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:44.905095 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:44.905396 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:44.905489 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:44.908386 (+ 2897us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.65:50503: BlockingRecv error: recv got EOF from 127.20.244.65:50503 (error 108)
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":111,"threads_started":1}
Aug 11 11:45:45 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:45 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:45.101020 32661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:45.095336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.66:55609)
0811 11:45:45.095611 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:45.095626 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:45.095733 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:45.096005 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:45.096007 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:45.096186 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:45.096282 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:45.096287 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:45.097103 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:45.097105 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:45.097651 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:45.097659 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:45.098104 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:45.098107 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:45.098173 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:45.098749 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:45.098772 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:45.100873 (+ 2101us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":110,"threads_started":1}
W20260811 11:45:45.101177 32660 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:45.095384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:55609 (local address 127.20.244.126:39323)
0811 11:45:45.095576 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:45.095580 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:45.095708 (+ 128us) server_negotiation.cc:407] Connection header received
0811 11:45:45.095828 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:45.095831 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:45.095885 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:45.095975 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:45.096400 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:45.096991 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:45.097772 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:45.097990 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:45.098083 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:45.101022 (+ 2939us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.66:55609: BlockingRecv error: recv got EOF from 127.20.244.66:55609 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 11 11:45:45 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:45 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:45.298657 32663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:45.292659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.67:51939)
0811 11:45:45.293043 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:45.293058 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:45.293176 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:45.293457 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:45.293459 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:45.293643 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:45.293738 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:45.293744 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:45.294555 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:45.294558 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:45.295227 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:45.295238 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:45.295739 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:45.295742 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:45.295832 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:45.296353 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:45.296364 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:45.298515 (+ 2151us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":148,"threads_started":1}
W20260811 11:45:45.298765 32660 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:45.292813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:51939 (local address 127.20.244.126:39323)
0811 11:45:45.293029 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:45.293033 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:45.293182 (+ 149us) server_negotiation.cc:407] Connection header received
0811 11:45:45.293254 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:45.293256 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:45.293339 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:45.293414 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:45.293868 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:45.294423 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:45.295371 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:45.295610 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:45.295692 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:45.298634 (+ 2942us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.67:51939: BlockingRecv error: recv got EOF from 127.20.244.67:51939 (error 108)
Metrics: {"server-negotiator.queue_time_us":110}
Aug 11 11:45:45 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:45 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:45.915371 32665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:45.909460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.65:50333)
0811 11:45:45.909908 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:45.909928 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:45.910051 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:45.910351 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:45.910354 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:45.910573 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:45.910674 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:45.910681 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:45.911571 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:45.911574 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:45.912180 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:45.912188 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:45.912647 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:45.912650 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:45.912715 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:45.913233 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:45.913245 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:45.915199 (+ 1954us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":90,"threads_started":1}
W20260811 11:45:45.915504 32667 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:45.909492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:50333 (local address 127.20.244.126:39323)
0811 11:45:45.909798 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:45.909805 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:45.910008 (+ 203us) server_negotiation.cc:407] Connection header received
0811 11:45:45.910133 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:45.910136 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:45.910182 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:45.910360 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:45.910781 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:45.911458 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:45.912319 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:45.912541 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:45.912626 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:45.915369 (+ 2743us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.65:50333: BlockingRecv error: recv got EOF from 127.20.244.65:50333 (error 108)
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":99,"threads_started":1}
Aug 11 11:45:46 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:46 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:46.108121 32668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:46.101799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.66:35277)
0811 11:45:46.102179 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:46.102205 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:46.102393 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:46.102719 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:46.102722 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:46.102954 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:46.103053 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:46.103060 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:46.103967 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:46.103972 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:46.104615 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:46.104623 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:46.105130 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:46.105134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:46.105230 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:46.105794 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:46.105808 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:46.107994 (+ 2186us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":90,"threads_started":1}
W20260811 11:45:46.108338 32667 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:46.101938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:35277 (local address 127.20.244.126:39323)
0811 11:45:46.102140 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:46.102145 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:46.102319 (+ 174us) server_negotiation.cc:407] Connection header received
0811 11:45:46.102529 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:46.102532 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:46.102587 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:46.102690 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:46.103214 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:46.103840 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:46.104749 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:46.105002 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:46.105124 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:46.108163 (+ 3039us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.66:35277: BlockingRecv error: recv got EOF from 127.20.244.66:35277 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 11 11:45:46 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:46 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:46.305099 32669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:46.299464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.67:34429)
0811 11:45:46.299770 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:46.299784 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:46.299892 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:46.300168 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:46.300171 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:46.300360 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:46.300459 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:46.300464 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:46.301221 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:46.301224 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:46.301806 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:46.301814 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:46.302400 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:46.302404 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:46.302486 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:46.303047 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:46.303060 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:46.304956 (+ 1896us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":120,"threads_started":1}
W20260811 11:45:46.305207 32667 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:46.299549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:34429 (local address 127.20.244.126:39323)
0811 11:45:46.299680 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:46.299683 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:46.299858 (+ 175us) server_negotiation.cc:407] Connection header received
0811 11:45:46.299973 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:46.299976 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:46.300023 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:46.300092 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:46.300577 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:46.301121 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:46.301920 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:46.302161 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:46.302241 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:46.305092 (+ 2851us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.67:34429: BlockingRecv error: recv got EOF from 127.20.244.67:34429 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 11 11:45:46 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:46 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:46.921975 32670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:46.916259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.65:38797)
0811 11:45:46.916576 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:46.916591 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:46.916694 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:46.916966 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:46.916968 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:46.917160 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:46.917260 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:46.917265 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:46.918106 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:46.918108 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:46.918712 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:46.918723 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:46.919183 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:46.919186 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:46.919255 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:46.919898 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:46.919910 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:46.921856 (+ 1946us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":125,"threads_started":1}
W20260811 11:45:46.922200 32672 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:46.916321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:38797 (local address 127.20.244.126:39323)
0811 11:45:46.916604 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:46.916608 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:46.916644 (+ 36us) server_negotiation.cc:407] Connection header received
0811 11:45:46.916779 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:46.916781 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:46.916827 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:46.916910 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:46.917420 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:46.917975 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:46.918831 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:46.919065 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:46.919166 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:46.922012 (+ 2846us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.65:38797: BlockingRecv error: recv got EOF from 127.20.244.65:38797 (error 108)
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":126,"threads_started":1}
Aug 11 11:45:47 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:47 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:47.115253 32673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:47.108959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.66:55571)
0811 11:45:47.109333 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:47.109351 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:47.109511 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:47.109862 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:47.109865 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:47.110075 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:47.110168 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:47.110174 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:47.111028 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:47.111033 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:47.111702 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:47.111711 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:47.112234 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:47.112237 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:47.112314 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:47.112916 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:47.112931 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:47.115127 (+ 2196us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":98,"threads_started":1}
W20260811 11:45:47.115371 32672 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:47.109088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:55571 (local address 127.20.244.126:39323)
0811 11:45:47.109326 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:47.109332 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:47.109443 (+ 111us) server_negotiation.cc:407] Connection header received
0811 11:45:47.109626 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:47.109629 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:47.109721 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:47.109821 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:47.110296 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:47.110904 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:47.111835 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:47.112113 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:47.112228 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:47.115271 (+ 3043us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.66:55571: BlockingRecv error: recv got EOF from 127.20.244.66:55571 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 11 11:45:47 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:47 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:47.312156 32674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:47.306140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.67:56439)
0811 11:45:47.306434 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:47.306456 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:47.306557 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:47.306876 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:47.306878 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:47.307059 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:47.307185 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:47.307190 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:47.308000 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:47.308003 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:47.308548 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:47.308555 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:47.309010 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:47.309013 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:47.309075 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:47.309661 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:47.309673 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:47.312040 (+ 2367us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":110,"threads_started":1}
W20260811 11:45:47.312263 32672 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:47.306207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:56439 (local address 127.20.244.126:39323)
0811 11:45:47.306365 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:47.306369 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:47.306530 (+ 161us) server_negotiation.cc:407] Connection header received
0811 11:45:47.306695 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:47.306698 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:47.306747 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:47.306826 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:47.307325 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:47.307885 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:47.308672 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:47.308903 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:47.308993 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:47.312149 (+ 3156us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.67:56439: BlockingRecv error: recv got EOF from 127.20.244.67:56439 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 11 11:45:47 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:47 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:47.933142 32675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:47.922852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.65:44859)
0811 11:45:47.923180 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:47.923194 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:47.923282 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:47.923570 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:47.923572 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:47.923769 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:47.923876 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:47.923882 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:47.924856 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:47.924859 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:47.925470 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:47.925481 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:47.926065 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:47.926068 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:47.926133 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:47.930793 (+ 4660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:47.930831 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:47.933019 (+ 2188us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":117,"threads_started":1}
W20260811 11:45:47.933295 32676 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:47.922978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:44859 (local address 127.20.244.126:39323)
0811 11:45:47.923223 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:47.923226 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:47.923241 (+ 15us) server_negotiation.cc:407] Connection header received
0811 11:45:47.923400 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:47.923403 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:47.923446 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:47.923532 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:47.923992 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:47.924746 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:47.925606 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:47.925954 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:47.926042 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:47.933166 (+ 7124us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.65:44859: BlockingRecv error: recv got EOF from 127.20.244.65:44859 (error 108)
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":108,"threads_started":1}
Aug 11 11:45:48 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:48 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:48.122180 32680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:48.116337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.66:39293)
0811 11:45:48.116683 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:48.116696 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:48.116788 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:48.117048 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:48.117050 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:48.117249 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:48.117368 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:48.117374 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:48.118094 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:48.118096 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:48.118691 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:48.118700 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:48.119236 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:48.119240 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:48.119372 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:48.120014 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:48.120029 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:48.122063 (+ 2034us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":110,"threads_started":1}
W20260811 11:45:48.122324 32676 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:48.116564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:39293 (local address 127.20.244.126:39323)
0811 11:45:48.116744 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:48.116747 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:48.116764 (+ 17us) server_negotiation.cc:407] Connection header received
0811 11:45:48.116879 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:48.116882 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:48.116926 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:48.117007 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:48.117477 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:48.117999 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:48.118808 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:48.119028 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:48.119218 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:48.122201 (+ 2983us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.66:39293: BlockingRecv error: recv got EOF from 127.20.244.66:39293 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 11 11:45:48 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:48 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:48.318843 32681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:48.313163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.67:51433)
0811 11:45:48.313464 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:48.313477 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:48.313570 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:48.313802 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:48.313804 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:48.313991 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:48.314092 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:48.314097 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:48.314924 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:48.314927 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:48.315534 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:48.315544 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:48.316026 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:48.316030 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:48.316101 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:48.316684 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:48.316696 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:48.318709 (+ 2013us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":125,"threads_started":1}
W20260811 11:45:48.319046 32676 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:48.313296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:51433 (local address 127.20.244.126:39323)
0811 11:45:48.313433 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:48.313437 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:48.313526 (+ 89us) server_negotiation.cc:407] Connection header received
0811 11:45:48.313653 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:48.313655 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:48.313698 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:48.313758 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:48.314219 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:48.314801 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:48.315652 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:48.315898 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:48.315982 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:48.318898 (+ 2916us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.67:51433: BlockingRecv error: recv got EOF from 127.20.244.67:51433 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 11 11:45:48 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:48 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:48.940099 32682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:48.934083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.65:56735)
0811 11:45:48.934433 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:48.934447 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:48.934553 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:48.934814 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:48.934816 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:48.935009 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:48.935181 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:48.935188 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:48.936000 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:48.936003 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:48.936579 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:48.936588 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:48.937081 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:48.937083 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:48.937148 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:48.937779 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:48.937794 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:48.939966 (+ 2172us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":88,"threads_started":1}
W20260811 11:45:48.940253 32685 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:48.934211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:56735 (local address 127.20.244.126:39323)
0811 11:45:48.934451 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:48.934455 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:48.934517 (+ 62us) server_negotiation.cc:407] Connection header received
0811 11:45:48.934647 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:48.934650 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:48.934695 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:48.934775 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:48.935332 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:48.935869 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:48.936731 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:48.936969 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:48.937059 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:48.940109 (+ 3050us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.65:56735: BlockingRecv error: recv got EOF from 127.20.244.65:56735 (error 108)
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":67,"threads_started":1}
Aug 11 11:45:49 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:49 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:49.129334 32686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:49.123057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.66:54513)
0811 11:45:49.123527 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:49.123541 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:49.123652 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:49.123900 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:49.123902 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:49.124111 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:49.124208 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:49.124214 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:49.125124 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:49.125127 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:49.125901 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:49.125912 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:49.126454 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:49.126458 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:49.126547 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:49.127165 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:49.127181 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:49.129208 (+ 2027us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":119,"threads_started":1}
W20260811 11:45:49.129523 32685 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:49.123154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:54513 (local address 127.20.244.126:39323)
0811 11:45:49.123322 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:49.123325 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:49.123635 (+ 310us) server_negotiation.cc:407] Connection header received
0811 11:45:49.123735 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:49.123738 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:49.123788 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:49.123862 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:49.124377 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:49.125011 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:49.126037 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:49.126331 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:49.126448 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:49.129360 (+ 2912us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.66:54513: BlockingRecv error: recv got EOF from 127.20.244.66:54513 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 11 11:45:49 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:49 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:49.325382 32687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:49.319719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.67:44893)
0811 11:45:49.320067 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:49.320080 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:49.320182 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:49.320433 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:49.320436 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:49.320618 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:49.320706 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:49.320711 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:49.321489 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:49.321491 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:49.322061 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:49.322068 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:49.322571 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:49.322574 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:49.322632 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:49.323193 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:49.323207 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:49.325244 (+ 2037us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":170,"threads_started":1}
W20260811 11:45:49.325552 32685 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:49.319803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:44893 (local address 127.20.244.126:39323)
0811 11:45:49.319991 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:49.319996 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:49.320155 (+ 159us) server_negotiation.cc:407] Connection header received
0811 11:45:49.320270 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:49.320272 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:49.320320 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:49.320388 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:49.320813 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:49.321393 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:49.322192 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:49.322464 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:49.322555 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:49.325391 (+ 2836us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.67:44893: BlockingRecv error: recv got EOF from 127.20.244.67:44893 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
Aug 11 11:45:49 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:49 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:49.947019 32688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:49.940970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.65:42009)
0811 11:45:49.941346 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:49.941361 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:49.941459 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:49.941812 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:49.941815 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:49.942102 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:49.942287 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:49.942296 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:49.943385 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:49.943388 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:49.943995 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:49.944005 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:49.944489 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:49.944492 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:49.944556 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:49.945031 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:49.945042 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:49.946903 (+ 1861us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":107,"threads_started":1}
W20260811 11:45:49.947232 32689 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:49.941097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:42009 (local address 127.20.244.126:39323)
0811 11:45:49.941382 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:49.941387 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:49.941408 (+ 21us) server_negotiation.cc:407] Connection header received
0811 11:45:49.941584 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:49.941587 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:49.941650 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:49.941760 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:49.942448 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:49.943271 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:49.944105 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:49.944379 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:49.944462 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:49.947036 (+ 2574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.65:42009: BlockingRecv error: recv got EOF from 127.20.244.65:42009 (error 108)
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":91,"threads_started":1}
Aug 11 11:45:50 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:50 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:50.136010 32690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:50.130165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.66:53795)
0811 11:45:50.130578 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:50.130591 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:50.130695 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:50.130943 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:50.130945 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:50.131177 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:50.131272 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:50.131279 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:50.132089 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:50.132092 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:50.132684 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:50.132693 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:50.133193 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:50.133196 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:50.133287 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:50.133838 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:50.133851 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:50.135887 (+ 2036us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":118,"threads_started":1}
W20260811 11:45:50.136157 32689 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:50.130227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:53795 (local address 127.20.244.126:39323)
0811 11:45:50.130416 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:50.130422 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:50.130683 (+ 261us) server_negotiation.cc:407] Connection header received
0811 11:45:50.130775 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:50.130777 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:50.130830 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:50.130905 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:50.131410 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:50.131978 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:50.132813 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:50.133056 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:50.133146 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:50.136037 (+ 2891us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.66:53795: BlockingRecv error: recv got EOF from 127.20.244.66:53795 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 11:45:50 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:50 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:50.332331 32691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:50.326431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.67:33833)
0811 11:45:50.326866 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:50.326884 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:50.327011 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:50.327318 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:50.327321 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:50.327539 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:50.327632 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:50.327638 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:50.328429 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:50.328435 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:50.329097 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:50.329114 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:50.329594 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:50.329597 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:50.329684 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:50.330220 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:50.330232 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:50.332158 (+ 1926us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":121,"threads_started":1}
W20260811 11:45:50.332414 32689 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:50.326604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:33833 (local address 127.20.244.126:39323)
0811 11:45:50.326745 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:50.326750 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:50.326970 (+ 220us) server_negotiation.cc:407] Connection header received
0811 11:45:50.327136 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:50.327139 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:50.327197 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:50.327288 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:50.327764 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:50.328304 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:50.329233 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:50.329471 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:50.329579 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:50.332286 (+ 2707us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.67:33833: BlockingRecv error: recv got EOF from 127.20.244.67:33833 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 11 11:45:50 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:50 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:50.953771 32692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:50.947888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.65:35895)
0811 11:45:50.948192 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:50.948206 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:50.948302 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:50.948628 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:50.948630 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:50.948818 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:50.948916 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:50.948921 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:50.949840 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:50.949843 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:50.950436 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:50.950448 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:50.950974 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:50.950977 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:50.951040 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:50.951570 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:50.951582 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:50.953653 (+ 2071us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":114,"threads_started":1}
W20260811 11:45:50.954033 32693 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:50.948061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:35895 (local address 127.20.244.126:39323)
0811 11:45:50.948377 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:50.948381 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:50.948397 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:45:50.948439 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:50.948441 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:50.948490 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:50.948600 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:50.949040 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:50.949692 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:50.950572 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:50.950860 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:50.950961 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:50.953853 (+ 2892us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.65:35895: BlockingRecv error: recv got EOF from 127.20.244.65:35895 (error 108)
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":119,"threads_started":1}
Aug 11 11:45:51 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:51 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:51.142958 32695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:51.136971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.66:56369)
0811 11:45:51.137377 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:51.137393 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:51.137498 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:51.137779 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:51.137782 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:51.137973 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:51.138067 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:51.138072 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:51.139003 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:51.139005 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:51.139579 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:51.139587 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:51.140023 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:51.140026 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:51.140085 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:51.140699 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:51.140719 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:51.142817 (+ 2098us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":231,"threads_started":1}
W20260811 11:45:51.143142 32693 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:51.137050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:56369 (local address 127.20.244.126:39323)
0811 11:45:51.137365 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:51.137375 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:51.137472 (+ 97us) server_negotiation.cc:407] Connection header received
0811 11:45:51.137593 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:51.137595 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:51.137649 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:51.137755 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:51.138193 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:51.138902 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:51.139684 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:51.139916 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:51.140007 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:51.142979 (+ 2972us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.66:56369: BlockingRecv error: recv got EOF from 127.20.244.66:56369 (error 108)
Metrics: {"server-negotiator.queue_time_us":197}
Aug 11 11:45:51 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:51 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:51.338220 32696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:51.333052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.67:45303)
0811 11:45:51.333322 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:51.333335 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:51.333433 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:51.333668 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:51.333670 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:51.333844 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:51.333947 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:51.333953 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:51.334663 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:51.334665 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:51.335261 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:51.335268 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:51.335648 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:51.335651 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:51.335730 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:51.336222 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:51.336233 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:51.338108 (+ 1875us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":112,"threads_started":1}
W20260811 11:45:51.338446 32693 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:51.333140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:45303 (local address 127.20.244.126:39323)
0811 11:45:51.333335 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:51.333339 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:51.333403 (+ 64us) server_negotiation.cc:407] Connection header received
0811 11:45:51.333513 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:51.333516 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:51.333562 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:51.333631 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:51.334043 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:51.334574 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:51.335351 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:51.335554 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:51.335628 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:51.338246 (+ 2618us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.67:45303: BlockingRecv error: recv got EOF from 127.20.244.67:45303 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 11 11:45:51 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:51 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:51.960279 32697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:51.954623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.65:47455)
0811 11:45:51.954904 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:51.954917 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:51.955008 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:51.955283 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:51.955285 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:51.955488 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:51.955583 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:51.955588 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:51.956359 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:51.956361 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:51.956909 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:51.956916 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:51.957334 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:51.957337 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:51.957411 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:51.957894 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:51.957905 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:51.960019 (+ 2114us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":97,"threads_started":1}
W20260811 11:45:51.960291 32698 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:51.954698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:47455 (local address 127.20.244.126:39323)
0811 11:45:51.954967 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:51.954970 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:51.954985 (+ 15us) server_negotiation.cc:407] Connection header received
0811 11:45:51.955117 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:51.955119 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:51.955165 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:51.955244 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:51.955702 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:51.956259 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:51.957015 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:51.957236 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:51.957317 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:51.960159 (+ 2842us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.65:47455: BlockingRecv error: recv got EOF from 127.20.244.65:47455 (error 108)
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":74,"threads_started":1}
Aug 11 11:45:52 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:52 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:52.149801 32701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:52.143777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.66:35515)
0811 11:45:52.144112 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:52.144126 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:52.144228 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:52.144469 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:52.144471 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:52.144651 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:52.144756 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:52.144762 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:52.145701 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:52.145703 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:52.146244 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:52.146286 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:52.146774 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:52.146778 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:52.146873 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:52.147516 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:52.147533 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:52.149688 (+ 2155us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":136,"threads_started":1}
W20260811 11:45:52.149996 32698 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:52.143839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:35515 (local address 127.20.244.126:39323)
0811 11:45:52.144008 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:52.144013 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:52.144211 (+ 198us) server_negotiation.cc:407] Connection header received
0811 11:45:52.144301 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:52.144303 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:52.144353 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:52.144434 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:52.144864 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:52.145596 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:52.146415 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:52.146658 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:52.146750 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:52.149834 (+ 3084us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.66:35515: BlockingRecv error: recv got EOF from 127.20.244.66:35515 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 11:45:52 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:52 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:52.345126 32702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:52.339221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.67:59409)
0811 11:45:52.339554 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:52.339567 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:52.339697 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:52.339996 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:52.340000 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:52.340216 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:52.340309 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:52.340315 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:52.341160 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:52.341165 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:52.341731 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:52.341740 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:52.342283 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:52.342287 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:52.342372 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:52.342901 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:52.342913 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:52.344935 (+ 2022us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":122,"threads_started":1}
W20260811 11:45:52.345187 32698 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:52.339214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:59409 (local address 127.20.244.126:39323)
0811 11:45:52.339449 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:52.339453 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:52.339640 (+ 187us) server_negotiation.cc:407] Connection header received
0811 11:45:52.339805 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:52.339808 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:52.339870 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:52.339973 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:52.340444 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:52.341053 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:52.341850 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:52.342161 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:52.342267 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:52.345073 (+ 2806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.67:59409: BlockingRecv error: recv got EOF from 127.20.244.67:59409 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
Aug 11 11:45:52 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:52 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:52.971793 32703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:52.961245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.65:40385)
0811 11:45:52.961548 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:52.961562 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:52.961647 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:52.961903 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:52.961905 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:52.962084 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:52.962179 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:52.962184 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:52.962986 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:52.962988 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:52.963555 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:52.963563 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:52.964021 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:52.964024 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:52.964082 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:52.969280 (+ 5198us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:52.969294 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:52.971604 (+ 2310us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":99,"threads_started":1}
W20260811 11:45:52.971870 32704 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:52.961366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:40385 (local address 127.20.244.126:39323)
0811 11:45:52.961635 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:52.961638 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:52.961653 (+ 15us) server_negotiation.cc:407] Connection header received
0811 11:45:52.961742 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:52.961745 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:52.961790 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:52.961890 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:52.962295 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:52.962886 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:52.963661 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:52.963918 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:52.964006 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:52.971737 (+ 7731us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.65:40385: BlockingRecv error: recv got EOF from 127.20.244.65:40385 (error 108)
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":64,"threads_started":1}
Aug 11 11:45:53 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:53 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:53.156446 32705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:53.150656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.66:37021)
0811 11:45:53.150972 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:53.150988 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:53.151127 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:53.151426 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:53.151430 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:53.151628 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:53.151736 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:53.151743 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:53.152487 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:53.152490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:53.153038 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:53.153045 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:53.153503 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:53.153506 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:53.153575 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:53.154164 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:53.154176 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:53.156252 (+ 2076us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":121,"threads_started":1}
W20260811 11:45:53.156503 32704 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:53.150752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:37021 (local address 127.20.244.126:39323)
0811 11:45:53.150909 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:53.150912 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:53.151049 (+ 137us) server_negotiation.cc:407] Connection header received
0811 11:45:53.151204 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:53.151206 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:53.151246 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:53.151316 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:53.151855 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:53.152373 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:53.153147 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:53.153364 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:53.153494 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:53.156387 (+ 2893us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.66:37021: BlockingRecv error: recv got EOF from 127.20.244.66:37021 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 11 11:45:53 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:53 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:53.352022 32706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:53.346021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.67:35169)
0811 11:45:53.346342 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:53.346362 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:53.346480 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:53.346761 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:53.346765 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:53.346994 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:53.347160 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:53.347175 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:53.347971 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:53.347977 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:53.348542 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:53.348549 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:53.349010 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:53.349014 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:53.349101 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:53.349661 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:53.349673 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:53.351840 (+ 2167us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":96,"threads_started":1}
W20260811 11:45:53.352236 32704 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:53.346206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:35169 (local address 127.20.244.126:39323)
0811 11:45:53.346378 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:53.346386 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:53.346424 (+ 38us) server_negotiation.cc:407] Connection header received
0811 11:45:53.346587 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:53.346591 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:53.346643 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:53.346730 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:53.347335 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:53.347859 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:53.348666 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:53.348896 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:53.349006 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:53.352104 (+ 3098us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.67:35169: BlockingRecv error: recv got EOF from 127.20.244.67:35169 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 11 11:45:53 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:53 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:53.979036 32707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:53.972676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.65:42641)
0811 11:45:53.973004 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:53.973020 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:53.973128 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:53.973460 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:53.973463 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:53.973721 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:53.973860 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:53.973868 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:53.974911 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:53.974914 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:53.975650 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:53.975662 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:53.976121 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:53.976125 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:53.976195 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:53.976718 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:53.976730 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:53.978867 (+ 2137us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":91,"threads_started":1}
W20260811 11:45:53.979194 32708 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:53.972812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:42641 (local address 127.20.244.126:39323)
0811 11:45:53.973070 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:53.973074 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:53.973088 (+ 14us) server_negotiation.cc:407] Connection header received
0811 11:45:53.973234 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:53.973238 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:53.973293 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:53.973396 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:53.973996 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:53.974778 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:53.975769 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:53.975996 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:53.976073 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:53.979017 (+ 2944us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.65:42641: BlockingRecv error: recv got EOF from 127.20.244.65:42641 (error 108)
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":70,"threads_started":1}
Aug 11 11:45:54 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:54 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:54.163308 32709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:54.157537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.66:37623)
0811 11:45:54.157849 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:54.157862 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:54.158002 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:54.158274 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:54.158278 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:54.158502 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:54.158594 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:54.158600 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:54.159437 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:54.159442 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:54.160060 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:54.160071 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:54.160608 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:54.160612 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:54.160699 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:54.161268 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:54.161281 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:54.163136 (+ 1855us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":101,"threads_started":1}
W20260811 11:45:54.163353 32708 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:54.157609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:37623 (local address 127.20.244.126:39323)
0811 11:45:54.157795 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:54.157799 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:54.157944 (+ 145us) server_negotiation.cc:407] Connection header received
0811 11:45:54.158107 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:54.158111 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:54.158164 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:54.158251 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:54.158714 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:54.159327 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:54.160184 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:54.160485 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:54.160593 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:54.163253 (+ 2660us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.66:37623: BlockingRecv error: recv got EOF from 127.20.244.66:37623 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 11 11:45:54 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:54 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:54.358247 32710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:54.352799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.67:40191)
0811 11:45:54.353102 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:54.353116 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:54.353225 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:54.353465 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:54.353467 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:54.353650 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:54.353747 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:54.353760 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:54.354522 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:54.354525 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:54.355163 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:54.355173 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:54.355635 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:54.355638 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:54.355709 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:54.356229 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:54.356241 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:54.358075 (+ 1834us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":107,"threads_started":1}
W20260811 11:45:54.358346 32708 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:54.352889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:40191 (local address 127.20.244.126:39323)
0811 11:45:54.353051 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:54.353059 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:54.353195 (+ 136us) server_negotiation.cc:407] Connection header received
0811 11:45:54.353299 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:54.353301 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:54.353348 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:54.353431 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:54.353857 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:54.354370 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:54.355272 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:54.355507 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:54.355589 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:54.358221 (+ 2632us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.67:40191: BlockingRecv error: recv got EOF from 127.20.244.67:40191 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 11 11:45:54 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:54 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:54.985450 32711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:54.979878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.65:43463)
0811 11:45:54.980150 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:54.980164 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:54.980262 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:54.980548 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:54.980550 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:54.980736 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:54.980855 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:54.980861 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:54.981629 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:54.981632 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:54.982205 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:54.982213 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:54.982672 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:54.982675 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:54.982744 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:54.983322 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:54.983343 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:54.985277 (+ 1934us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":94,"threads_started":1}
W20260811 11:45:54.985562 32712 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:54.979885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:43463 (local address 127.20.244.126:39323)
0811 11:45:54.980139 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:54.980142 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:54.980236 (+ 94us) server_negotiation.cc:407] Connection header received
0811 11:45:54.980369 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:54.980371 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:54.980431 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:54.980509 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:54.980958 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:54.981521 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:54.982306 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:54.982541 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:54.982618 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:54.985423 (+ 2805us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.65:43463: BlockingRecv error: recv got EOF from 127.20.244.65:43463 (error 108)
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":93,"threads_started":1}
Aug 11 11:45:55 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:55 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:55.170178 32713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:55.164179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.66:37909)
0811 11:45:55.164470 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:55.164484 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:55.164591 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:55.164831 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:55.164833 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:55.165052 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:55.165149 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:55.165155 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:55.166262 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:55.166265 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:55.167023 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:55.167033 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:55.167600 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:55.167603 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:55.167666 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:55.168171 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:55.168182 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:55.170061 (+ 1879us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":94,"threads_started":1}
W20260811 11:45:55.170442 32712 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:55.164300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:37909 (local address 127.20.244.126:39323)
0811 11:45:55.164462 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:55.164466 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:55.164593 (+ 127us) server_negotiation.cc:407] Connection header received
0811 11:45:55.164656 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:55.164658 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:55.164707 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:55.164785 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:55.165286 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:55.166123 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:55.167211 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:55.167483 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:55.167576 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:55.170201 (+ 2625us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.66:37909: BlockingRecv error: recv got EOF from 127.20.244.66:37909 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 11 11:45:55 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:55 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:55.365386 32714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:55.359362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.67:33685)
0811 11:45:55.359674 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:55.359689 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:55.359817 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:55.360091 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:55.360094 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:55.360330 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:55.360436 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:55.360443 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:55.361218 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:55.361221 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:55.361839 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:55.361850 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:55.362342 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:55.362345 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:55.362433 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:55.362985 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:55.362998 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:55.365204 (+ 2206us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":122,"threads_started":1}
W20260811 11:45:55.365444 32712 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:55.359462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:33685 (local address 127.20.244.126:39323)
0811 11:45:55.359603 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:55.359607 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:55.359769 (+ 162us) server_negotiation.cc:407] Connection header received
0811 11:45:55.359918 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:55.359921 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:55.359968 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:55.360042 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:55.360551 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:55.361084 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:55.361954 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:55.362170 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:55.362245 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:55.365334 (+ 3089us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.67:33685: BlockingRecv error: recv got EOF from 127.20.244.67:33685 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 11 11:45:55 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:55 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:55.992504 32715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:55.986418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.65:46047)
0811 11:45:55.986717 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:55.986735 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:55.986882 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:55.987262 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:55.987265 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:55.987539 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:55.987701 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:55.987710 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:55.988522 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:55.988525 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:55.989172 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:55.989181 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:55.989603 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:55.989606 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:55.989677 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:55.990182 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:55.990196 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:55.992345 (+ 2149us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":72,"threads_started":1}
W20260811 11:45:55.992583 32716 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:55.986460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:46047 (local address 127.20.244.126:39323)
0811 11:45:55.986792 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:55.986798 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:55.986815 (+ 17us) server_negotiation.cc:407] Connection header received
0811 11:45:55.987035 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:55.987038 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:55.987132 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:55.987222 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:55.987846 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:55.988410 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:55.989276 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:55.989500 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:55.989574 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:55.992474 (+ 2900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.65:46047: BlockingRecv error: recv got EOF from 127.20.244.65:46047 (error 108)
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":128,"threads_started":1}
Aug 11 11:45:56 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:56 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:56.176739 32718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:56.171005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.66:48283)
0811 11:45:56.171361 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:56.171375 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:56.171474 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:56.171723 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:56.171725 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:56.171913 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:56.172012 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:56.172017 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:56.172782 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:56.172785 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:56.173424 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:56.173435 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:56.173994 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:56.173997 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:56.174110 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:56.174694 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:56.174706 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:56.176624 (+ 1918us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":147,"threads_started":1}
W20260811 11:45:56.177038 32716 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:56.171214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:48283 (local address 127.20.244.126:39323)
0811 11:45:56.171388 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:56.171391 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:56.171424 (+ 33us) server_negotiation.cc:407] Connection header received
0811 11:45:56.171557 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:56.171559 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:56.171604 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:56.171680 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:56.172111 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:56.172676 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:56.173573 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:56.173874 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:56.173992 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:56.176763 (+ 2771us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.66:48283: BlockingRecv error: recv got EOF from 127.20.244.66:48283 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 11 11:45:56 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:56 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:56.371989 32719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:56.366231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.67:56943)
0811 11:45:56.366548 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:56.366562 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:56.366674 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:56.366923 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:56.366925 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:56.367177 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:56.367279 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:56.367285 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:56.368037 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:56.368040 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:56.368603 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:56.368611 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:56.369107 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:56.369110 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:56.369178 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:56.369671 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:56.369682 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:56.371794 (+ 2112us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":110,"threads_started":1}
W20260811 11:45:56.372035 32716 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:56.366391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:56943 (local address 127.20.244.126:39323)
0811 11:45:56.366541 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:56.366545 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:56.366678 (+ 133us) server_negotiation.cc:407] Connection header received
0811 11:45:56.366750 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:56.366753 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:56.366802 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:56.366878 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:56.367408 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:56.367937 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:56.368732 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:56.368974 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:56.369058 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:56.371929 (+ 2871us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.67:56943: BlockingRecv error: recv got EOF from 127.20.244.67:56943 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 11 11:45:56 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:56 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:56.999478 32720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:56.993434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.65:45771)
0811 11:45:56.993762 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:56.993779 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:56.993890 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:56.994203 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:56.994206 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:56.994433 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:56.994537 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:56.994543 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:56.995297 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:56.995300 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:56.995903 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:56.995911 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:56.996325 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:56.996328 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:56.996412 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:56.996922 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:56.996933 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:56.999295 (+ 2362us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":112,"threads_started":1}
W20260811 11:45:56.999589 32721 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:56.993487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:45771 (local address 127.20.244.126:39323)
0811 11:45:56.993809 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:56.993813 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:56.993828 (+ 15us) server_negotiation.cc:407] Connection header received
0811 11:45:56.993988 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:56.993991 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:56.994037 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:56.994119 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:56.994649 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:56.995199 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:56.996009 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:56.996227 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:56.996302 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:56.999447 (+ 3145us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.65:45771: BlockingRecv error: recv got EOF from 127.20.244.65:45771 (error 108)
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":97,"threads_started":1}
Aug 11 11:45:57 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:57 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:57.183398 32722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:57.177462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.66:39967)
0811 11:45:57.177777 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:57.177821 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:57.177959 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:57.178234 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:57.178237 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:57.178472 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:57.178567 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:57.178573 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:57.179418 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:57.179423 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:57.179999 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:57.180007 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:57.180486 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:57.180490 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:57.180577 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:57.181083 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:57.181094 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:57.183275 (+ 2181us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":87,"threads_started":1}
W20260811 11:45:57.183544 32721 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:57.177595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:39967 (local address 127.20.244.126:39323)
0811 11:45:57.177768 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:57.177773 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:57.177897 (+ 124us) server_negotiation.cc:407] Connection header received
0811 11:45:57.178060 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:57.178063 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:57.178114 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:57.178210 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:57.178687 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:57.179311 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:57.180119 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:57.180371 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:57.180482 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:57.183425 (+ 2943us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.66:39967: BlockingRecv error: recv got EOF from 127.20.244.66:39967 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 11 11:45:57 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:57 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.67@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:57.378197 32723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:57.372799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.67:41047)
0811 11:45:57.373087 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:57.373100 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:57.373214 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:57.373456 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:57.373458 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:57.373646 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:57.373741 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:57.373746 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:57.374464 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:57.374467 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:57.375059 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:57.375068 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:57.375603 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:57.375607 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:57.375696 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:57.376191 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:57.376202 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:57.378069 (+ 1867us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":73,"threads_started":1}
W20260811 11:45:57.378369 32721 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:57.372932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:41047 (local address 127.20.244.126:39323)
0811 11:45:57.373104 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:57.373107 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:57.373182 (+ 75us) server_negotiation.cc:407] Connection header received
0811 11:45:57.373293 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:57.373295 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:57.373342 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:57.373416 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:57.373841 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:57.374361 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:57.375229 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:57.375476 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:57.375596 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:57.378214 (+ 2618us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.67:41047: BlockingRecv error: recv got EOF from 127.20.244.67:41047 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 11 11:45:58 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:58 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.65@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 11:45:58.010588 32725 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:58.000582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:44049 (local address 127.20.244.126:39323)
0811 11:45:58.000824 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:58.000827 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:58.000841 (+ 14us) server_negotiation.cc:407] Connection header received
0811 11:45:58.000965 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:58.000967 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:58.001026 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:58.001104 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:58.001832 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:58.002372 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:58.003279 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:58.003521 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:58.003605 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:58.010363 (+ 6758us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.65:44049: BlockingRecv error: recv got EOF from 127.20.244.65:44049 (error 108)
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":97,"threads_started":1}
I20260811 11:45:58.010677 32724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:58.000484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.65:44049)
0811 11:45:58.000767 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:58.000787 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:58.000877 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:58.001145 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:58.001147 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:58.001584 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:58.001695 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:58.001702 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:58.002489 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:58.002493 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:58.003143 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:58.003158 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:58.003635 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:58.003637 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:58.003702 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:58.007705 (+ 4003us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:58.007723 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:58.010382 (+ 2659us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":100,"threads_started":1}
Aug 11 11:45:58 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:45:58 dist-test-slave-vkjp krb5kdc[31449](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.244.66@KRBTEST.COM for oryx/127.20.244.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:45:58.190733 32726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:58.184534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39323 (local address 127.20.244.66:45719)
0811 11:45:58.184868 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:58.184886 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:58.185006 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:58.185366 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:58.185374 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:58.185664 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:58.185803 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:58.185811 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:58.186660 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:58.186663 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:58.187242 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:58.187250 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:58.187714 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:58.187718 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:58.187803 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:58.188498 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:45:58.188526 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:58.190603 (+ 2077us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.244.126:39323: Server oryx/127.20.244.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":79,"threads_started":1}
W20260811 11:45:58.190878 32725 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:58.184640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:45719 (local address 127.20.244.126:39323)
0811 11:45:58.184819 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:58.184825 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:58.184953 (+ 128us) server_negotiation.cc:407] Connection header received
0811 11:45:58.185143 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:58.185146 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:58.185206 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:58.185325 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:58.185927 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:58.186559 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:58.187350 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:58.187570 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:58.187652 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:58.190748 (+ 3096us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.244.66:45719: BlockingRecv error: recv got EOF from 127.20.244.66:45719 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 11:45:58.266661 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 32149
I20260811 11:45:58.278035 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 32331
I20260811 11:45:58.287212 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 32490
I20260811 11:45:58.295790 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 32067
2026-08-11T11:45:58Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18296 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T11:45:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:45:58Z Disabled control of system clock
I20260811 11:45:58.331851 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:40169
--webserver_interface=127.20.244.126
--webserver_port=0
--builtin_ntp_servers=127.20.244.84:44231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:40169
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 11:45:58.454708 32733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:58.455011 32733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:58.455049 32733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:58.459684 32733 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:58.459770 32733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:58.459793 32733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:58.459812 32733 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:58.459828 32733 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:45:58.464839 32733 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:44231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:40169
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:40169
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32733
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:58.465975 32733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:58.467407 32733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:58.476416 32738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:58.476495 32733 server_base.cc:1034] running on GCE node
W20260811 11:45:58.476629 32741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:58.476548 32739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:58.477327 32733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:58.478493 32733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:58.479661 32733 hybrid_clock.cc:648] HybridClock initialized: now 1786448758479632 us; error 41 us; skew 500 ppm
I20260811 11:45:58.481674 32733 webserver.cc:460] Webserver started at http://127.20.244.126:37405/ using document root <none> and password file <none>
I20260811 11:45:58.482263 32733 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:58.482327 32733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:58.482575 32733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:58.484839 32733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "2e87a7c7a2f9480c8b6064cb2a30f973"
format_stamp: "Formatted at 2026-08-11 11:45:58 on dist-test-slave-vkjp"
server_key: "4005e9a6d40449112bee67207fa5b60f"
server_key_iv: "36fbc3c679d3ee0bde723716c3707dfe"
server_key_version: "encryptionkey@0"
I20260811 11:45:58.485419 32733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "2e87a7c7a2f9480c8b6064cb2a30f973"
format_stamp: "Formatted at 2026-08-11 11:45:58 on dist-test-slave-vkjp"
server_key: "4005e9a6d40449112bee67207fa5b60f"
server_key_iv: "36fbc3c679d3ee0bde723716c3707dfe"
server_key_version: "encryptionkey@0"
I20260811 11:45:58.489573 32733 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 11:45:58.492529 32747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:58.493952 32733 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 11:45:58.494095 32733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "2e87a7c7a2f9480c8b6064cb2a30f973"
format_stamp: "Formatted at 2026-08-11 11:45:58 on dist-test-slave-vkjp"
server_key: "4005e9a6d40449112bee67207fa5b60f"
server_key_iv: "36fbc3c679d3ee0bde723716c3707dfe"
server_key_version: "encryptionkey@0"
I20260811 11:45:58.494234 32733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:58.523533 32733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:58.524360 32733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:58.524587 32733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:58.532439 32733 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:40169
I20260811 11:45:58.532452 338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:40169 every 8 connection(s)
I20260811 11:45:58.533496 32733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:45:58.536827 339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:58.538542 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 32733
I20260811 11:45:58.538641 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:45:58.538965 21457 external_mini_cluster.cc:1428] Setting key 6a2fc38cfe2e633b01c44d0a558f9c25
I20260811 11:45:58.543995 339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973: Bootstrap starting.
I20260811 11:45:58.546609 339 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:58.547607 339 log.cc:824] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:58.549381 344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:58.540484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59804 (local address 127.20.244.126:40169)
0811 11:45:58.541206 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:58.541228 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:58.541272 (+ 44us) server_negotiation.cc:407] Connection header received
0811 11:45:58.542074 (+ 802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:58.542098 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:58.542601 (+ 503us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:58.542988 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:58.543448 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:58.544891 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:58.545762 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:58.546436 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:58.546609 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:58.547473 (+ 864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:58.547482 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:58.547499 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:58.548019 (+ 520us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:58.548095 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:58.548117 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:58.548234 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:58.548405 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 11:45:58.548662 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":123,"threads_started":1}
I20260811 11:45:58.549767 339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973: No bootstrap required, opened a new log
I20260811 11:45:58.553750 339 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e87a7c7a2f9480c8b6064cb2a30f973" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40169 } }
I20260811 11:45:58.554001 339 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:58.554081 339 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e87a7c7a2f9480c8b6064cb2a30f973, State: Initialized, Role: FOLLOWER
I20260811 11:45:58.554510 339 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e87a7c7a2f9480c8b6064cb2a30f973" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40169 } }
I20260811 11:45:58.554665 339 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:45:58.554754 339 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:45:58.554877 339 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:58.555917 339 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e87a7c7a2f9480c8b6064cb2a30f973" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40169 } }
I20260811 11:45:58.556269 339 leader_election.cc:302] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e87a7c7a2f9480c8b6064cb2a30f973; no voters:
I20260811 11:45:58.556667 339 leader_election.cc:288] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:45:58.556804 346 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:58.557044 346 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973 [term 1 LEADER]: Becoming Leader. State: Replica: 2e87a7c7a2f9480c8b6064cb2a30f973, State: Running, Role: LEADER
I20260811 11:45:58.557391 346 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e87a7c7a2f9480c8b6064cb2a30f973" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40169 } }
I20260811 11:45:58.557950 339 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:45:58.559186 347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e87a7c7a2f9480c8b6064cb2a30f973" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e87a7c7a2f9480c8b6064cb2a30f973" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40169 } } }
I20260811 11:45:58.559332 347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:58.559674 348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e87a7c7a2f9480c8b6064cb2a30f973. Latest consensus state: current_term: 1 leader_uuid: "2e87a7c7a2f9480c8b6064cb2a30f973" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e87a7c7a2f9480c8b6064cb2a30f973" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40169 } } }
I20260811 11:45:58.559765 348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:58.559768 356 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:45:58.563109 356 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:45:58.569125 356 catalog_manager.cc:1347] Generated new cluster ID: fdff9a37c6014025bf2ebdaa6383cf85
I20260811 11:45:58.569202 356 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:45:58.599700 356 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:45:58.600684 356 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:45:58.614936 356 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e87a7c7a2f9480c8b6064cb2a30f973: Generated new TSK 0
I20260811 11:45:58.615928 356 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:45:58.622224 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40169
--builtin_ntp_servers=127.20.244.84:44231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 11:45:58.742859 371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:58.743250 371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:58.743346 371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:58.747519 371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:58.747614 371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:58.747709 371 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:45:58.752595 371 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:44231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40169
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.371
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:58.753744 371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:58.755189 371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:58.765224 378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:58.765237 380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:58.765237 377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:58.765441 371 server_base.cc:1034] running on GCE node
I20260811 11:45:58.765961 371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:58.766593 371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:58.767797 371 hybrid_clock.cc:648] HybridClock initialized: now 1786448758767784 us; error 34 us; skew 500 ppm
I20260811 11:45:58.769766 371 webserver.cc:460] Webserver started at http://127.20.244.65:38563/ using document root <none> and password file <none>
I20260811 11:45:58.770380 371 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:58.770476 371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:58.770720 371 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:58.772980 371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "047199eadd244a3a94480ef0f173cd62"
format_stamp: "Formatted at 2026-08-11 11:45:58 on dist-test-slave-vkjp"
server_key: "d99833ea22c219ab42b4ca16a0b8508c"
server_key_iv: "4a1db7b03e9ef96dc27d95635f71e840"
server_key_version: "encryptionkey@0"
I20260811 11:45:58.773561 371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "047199eadd244a3a94480ef0f173cd62"
format_stamp: "Formatted at 2026-08-11 11:45:58 on dist-test-slave-vkjp"
server_key: "d99833ea22c219ab42b4ca16a0b8508c"
server_key_iv: "4a1db7b03e9ef96dc27d95635f71e840"
server_key_version: "encryptionkey@0"
I20260811 11:45:58.777515 371 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 11:45:58.780344 391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:58.781662 371 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:45:58.781804 371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "047199eadd244a3a94480ef0f173cd62"
format_stamp: "Formatted at 2026-08-11 11:45:58 on dist-test-slave-vkjp"
server_key: "d99833ea22c219ab42b4ca16a0b8508c"
server_key_iv: "4a1db7b03e9ef96dc27d95635f71e840"
server_key_version: "encryptionkey@0"
I20260811 11:45:58.781937 371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:58.800347 371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:58.801142 371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:58.801359 371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:58.801995 371 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:58.802989 371 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:58.803061 371 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:58.803167 371 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:58.803215 371 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:58.812620 371 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:40877
I20260811 11:45:58.812649 527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:40877 every 8 connection(s)
I20260811 11:45:58.813544 371 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:45:58.820672 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 371
I20260811 11:45:58.820830 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:45:58.821214 21457 external_mini_cluster.cc:1428] Setting key f3b219c008e83381689ee03c8a927aa6
I20260811 11:45:58.823462 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40169
--builtin_ntp_servers=127.20.244.84:44231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 11:45:58.823848 344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:58.815443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:48493 (local address 127.20.244.126:40169)
0811 11:45:58.815601 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:58.815606 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:58.816728 (+ 1122us) server_negotiation.cc:407] Connection header received
0811 11:45:58.818151 (+ 1423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:58.818154 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:58.818203 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:58.818282 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:58.819248 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:58.819813 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:58.821516 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:58.821812 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:58.821939 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:58.823303 (+ 1364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:58.823312 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:58.823314 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:58.823326 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:58.823345 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:58.823352 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:58.823433 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:58.823659 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 11:45:58.823734 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 11:45:58.825059 530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:58.815904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40169 (local address 127.20.244.65:48493)
0811 11:45:58.816565 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:58.816607 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:58.817937 (+ 1330us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:58.818488 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:58.818495 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:58.818577 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:58.819065 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:58.819106 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:58.819946 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:58.819949 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:58.821379 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:58.821393 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:58.822018 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:58.822023 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:58.822271 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:58.822968 (+ 697us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:45:58.822970 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:58.823012 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:45:58.823132 (+ 120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:58.823445 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:58.823456 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:58.823462 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 11:45:58.824033 (+ 571us) client_negotiation.cc:240] Negotiation successful
0811 11:45:58.824284 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":121,"threads_started":1}
I20260811 11:45:58.826534 528 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40169
I20260811 11:45:58.826782 528 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:58.827384 528 heartbeater.cc:511] Master 127.20.244.126:40169 requested a full tablet report, sending...
I20260811 11:45:58.828917 32767 ts_manager.cc:194] Registered new tserver with Master: 047199eadd244a3a94480ef0f173cd62 (127.20.244.65:40877)
I20260811 11:45:58.830081 32767 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.244.65:48493
W20260811 11:45:58.940714 531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:58.941053 531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:58.941135 531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:58.945269 531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:58.945358 531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:58.945449 531 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:45:58.950172 531 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:44231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40169
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.531
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:58.951438 531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:58.952920 531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:58.962803 539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:58.962757 538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:58.962822 541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:58.963337 531 server_base.cc:1034] running on GCE node
I20260811 11:45:58.963758 531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:58.964447 531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:58.965638 531 hybrid_clock.cc:648] HybridClock initialized: now 1786448758965623 us; error 30 us; skew 500 ppm
I20260811 11:45:58.967584 531 webserver.cc:460] Webserver started at http://127.20.244.66:43423/ using document root <none> and password file <none>
I20260811 11:45:58.968176 531 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:58.968273 531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:58.968565 531 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:58.970665 531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "8a5d679b41914c94800114081759e718"
format_stamp: "Formatted at 2026-08-11 11:45:58 on dist-test-slave-vkjp"
server_key: "a9d03c57641f66861a1a63bcad7b3b56"
server_key_iv: "c4c4ef04e886339a4fae3e9199bcbe50"
server_key_version: "encryptionkey@0"
I20260811 11:45:58.971370 531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "8a5d679b41914c94800114081759e718"
format_stamp: "Formatted at 2026-08-11 11:45:58 on dist-test-slave-vkjp"
server_key: "a9d03c57641f66861a1a63bcad7b3b56"
server_key_iv: "c4c4ef04e886339a4fae3e9199bcbe50"
server_key_version: "encryptionkey@0"
I20260811 11:45:58.975171 531 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 11:45:58.977816 548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:58.979183 531 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260811 11:45:58.979313 531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "8a5d679b41914c94800114081759e718"
format_stamp: "Formatted at 2026-08-11 11:45:58 on dist-test-slave-vkjp"
server_key: "a9d03c57641f66861a1a63bcad7b3b56"
server_key_iv: "c4c4ef04e886339a4fae3e9199bcbe50"
server_key_version: "encryptionkey@0"
I20260811 11:45:58.979449 531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:58.991043 531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:58.991778 531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:58.991987 531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:58.992575 531 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:58.993513 531 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:58.993585 531 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:58.993659 531 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:58.993705 531 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:59.002985 531 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:39819
I20260811 11:45:59.003021 678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:39819 every 8 connection(s)
I20260811 11:45:59.003954 531 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:45:59.011747 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 531
I20260811 11:45:59.011899 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:45:59.012253 21457 external_mini_cluster.cc:1428] Setting key 83fa167d4e354cac303049968751117c
I20260811 11:45:59.014827 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40169
--builtin_ntp_servers=127.20.244.84:44231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 11:45:59.017547 344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:59.006163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:37133 (local address 127.20.244.126:40169)
0811 11:45:59.006373 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:59.006378 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:59.009870 (+ 3492us) server_negotiation.cc:407] Connection header received
0811 11:45:59.011898 (+ 2028us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:59.011902 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:59.011971 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:59.012070 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:59.013375 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:59.013957 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:59.015459 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:59.015693 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:59.015808 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:59.017083 (+ 1275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:59.017086 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:59.017088 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:59.017101 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:59.017120 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:59.017128 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:59.017185 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:59.017384 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 11:45:59.017437 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 11:45:59.018659 682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:59.008720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40169 (local address 127.20.244.66:37133)
0811 11:45:59.009661 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:59.009741 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:59.011653 (+ 1912us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:59.012281 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:59.012294 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:59.012434 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:59.013200 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:59.013225 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:59.014098 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:59.014102 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:59.015320 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:59.015331 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:59.015853 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:59.015858 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:59.016036 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:59.016728 (+ 692us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:45:59.016733 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:59.016803 (+ 70us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:45:59.016897 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:59.017216 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:59.017226 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:59.017235 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 11:45:59.017381 (+ 146us) client_negotiation.cc:240] Negotiation successful
0811 11:45:59.017702 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":161,"threads_started":1}
I20260811 11:45:59.019860 680 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40169
I20260811 11:45:59.020123 680 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:59.020730 680 heartbeater.cc:511] Master 127.20.244.126:40169 requested a full tablet report, sending...
I20260811 11:45:59.021837 32767 ts_manager.cc:194] Registered new tserver with Master: 8a5d679b41914c94800114081759e718 (127.20.244.66:39819)
I20260811 11:45:59.022452 32767 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.244.66:37133
W20260811 11:45:59.131767 683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:59.132059 683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:59.132160 683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:59.136209 683 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:59.136289 683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:59.136376 683 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:45:59.141141 683 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:44231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40169
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.683
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:59.142277 683 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:59.143709 683 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:59.153151 689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:59.153199 683 server_base.cc:1034] running on GCE node
W20260811 11:45:59.153172 690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:59.153477 694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:59.153872 683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:59.154623 683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:59.155825 683 hybrid_clock.cc:648] HybridClock initialized: now 1786448759155805 us; error 34 us; skew 500 ppm
I20260811 11:45:59.157702 683 webserver.cc:460] Webserver started at http://127.20.244.67:37535/ using document root <none> and password file <none>
I20260811 11:45:59.158324 683 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:59.158421 683 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:59.158664 683 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:59.160916 683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "f212d16dc7cd483dbc0eb2c2fb67fcb2"
format_stamp: "Formatted at 2026-08-11 11:45:59 on dist-test-slave-vkjp"
server_key: "1097fce9d1f87449562c44344506c36d"
server_key_iv: "0f07bc5832fa1e22992f47821dc2ac4b"
server_key_version: "encryptionkey@0"
I20260811 11:45:59.161527 683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "f212d16dc7cd483dbc0eb2c2fb67fcb2"
format_stamp: "Formatted at 2026-08-11 11:45:59 on dist-test-slave-vkjp"
server_key: "1097fce9d1f87449562c44344506c36d"
server_key_iv: "0f07bc5832fa1e22992f47821dc2ac4b"
server_key_version: "encryptionkey@0"
I20260811 11:45:59.165297 683 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260811 11:45:59.167759 704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:59.169006 683 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:45:59.169138 683 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "f212d16dc7cd483dbc0eb2c2fb67fcb2"
format_stamp: "Formatted at 2026-08-11 11:45:59 on dist-test-slave-vkjp"
server_key: "1097fce9d1f87449562c44344506c36d"
server_key_iv: "0f07bc5832fa1e22992f47821dc2ac4b"
server_key_version: "encryptionkey@0"
I20260811 11:45:59.169251 683 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:59.190922 683 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:59.191651 683 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:59.191855 683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:59.192504 683 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:59.193444 683 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:59.193512 683 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:59.193584 683 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:59.193627 683 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:59.203265 683 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:40515
I20260811 11:45:59.203298 837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:40515 every 8 connection(s)
I20260811 11:45:59.204195 683 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:45:59.212828 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 683
I20260811 11:45:59.212958 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:45:59.213227 21457 external_mini_cluster.cc:1428] Setting key 3abdd6c3fbd25e637c066e1e6f2ce947
I20260811 11:45:59.214208 344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:59.206083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:39733 (local address 127.20.244.126:40169)
0811 11:45:59.206232 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:59.206238 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:59.207435 (+ 1197us) server_negotiation.cc:407] Connection header received
0811 11:45:59.209345 (+ 1910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:59.209348 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:59.209402 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:59.209479 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:59.210419 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:59.210944 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:59.212122 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:45:59.212337 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:45:59.212426 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:59.213675 (+ 1249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:59.213679 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:59.213682 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:59.213696 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:59.213726 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:59.213734 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:59.213832 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:59.214001 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 11:45:59.214068 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 11:45:59.215196 840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:59.206479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40169 (local address 127.20.244.67:39733)
0811 11:45:59.207234 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:59.207292 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:59.209128 (+ 1836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:59.209656 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:59.209663 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:59.209757 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:59.210253 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:59.210267 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:59.211101 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:59.211104 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:59.212007 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:45:59.212017 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:45:59.212533 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:45:59.212536 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:45:59.212682 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:45:59.213401 (+ 719us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:45:59.213403 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:59.213443 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:45:59.213506 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:59.213837 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:59.213849 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:59.213856 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 11:45:59.214000 (+ 144us) client_negotiation.cc:240] Negotiation successful
0811 11:45:59.214326 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":122,"threads_started":1}
I20260811 11:45:59.216365 838 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40169
I20260811 11:45:59.216632 838 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:59.217159 838 heartbeater.cc:511] Master 127.20.244.126:40169 requested a full tablet report, sending...
I20260811 11:45:59.218161 32767 ts_manager.cc:194] Registered new tserver with Master: f212d16dc7cd483dbc0eb2c2fb67fcb2 (127.20.244.67:40515)
I20260811 11:45:59.218715 32767 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.244.67:39733
I20260811 11:45:59.227277 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 11:45:59.230343 344 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:45:59.229322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59808 (local address 127.20.244.126:40169)
0811 11:45:59.229474 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:59.229478 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:59.229712 (+ 234us) server_negotiation.cc:407] Connection header received
0811 11:45:59.229829 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:59.229831 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:59.229872 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:59.229944 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:59.230234 (+ 290us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59808: BlockingRecv error: recv got EOF from 127.0.0.1:59808 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 11:45:59.230731 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 371
I20260811 11:45:59.242110 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 531
I20260811 11:45:59.251505 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 683
I20260811 11:45:59.262586 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 32733
2026-08-11T11:45:59Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (967 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T11:45:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:45:59Z Disabled control of system clock
I20260811 11:45:59.298051 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:40215
--webserver_interface=127.20.244.126
--webserver_port=0
--builtin_ntp_servers=127.20.244.84:34529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:40215
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 11:45:59.411895 853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:59.412137 853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:59.412171 853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:59.416102 853 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:45:59.416152 853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:59.416168 853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:59.416184 853 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:45:59.416200 853 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:45:59.420753 853 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:34529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:40215
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:40215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:59.421706 853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:59.422953 853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:59.431298 860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:59.431355 858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:59.431435 853 server_base.cc:1034] running on GCE node
W20260811 11:45:59.431372 863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:59.432212 853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:59.433262 853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:59.434448 853 hybrid_clock.cc:648] HybridClock initialized: now 1786448759434427 us; error 31 us; skew 500 ppm
I20260811 11:45:59.436396 853 webserver.cc:460] Webserver started at http://127.20.244.126:41441/ using document root <none> and password file <none>
I20260811 11:45:59.436980 853 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:59.437048 853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:59.437220 853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:59.439327 853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "7ec5ed01d0054a96a5d4b1e5fdc7e189"
format_stamp: "Formatted at 2026-08-11 11:45:59 on dist-test-slave-vkjp"
server_key: "1e2de8d7c3639db903aa761cc98c2ccd"
server_key_iv: "e8c97452d6cd3b20f4b498eef17803ad"
server_key_version: "encryptionkey@0"
I20260811 11:45:59.439874 853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "7ec5ed01d0054a96a5d4b1e5fdc7e189"
format_stamp: "Formatted at 2026-08-11 11:45:59 on dist-test-slave-vkjp"
server_key: "1e2de8d7c3639db903aa761cc98c2ccd"
server_key_iv: "e8c97452d6cd3b20f4b498eef17803ad"
server_key_version: "encryptionkey@0"
I20260811 11:45:59.443588 853 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 11:45:59.446090 871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:59.447423 853 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:45:59.447530 853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "7ec5ed01d0054a96a5d4b1e5fdc7e189"
format_stamp: "Formatted at 2026-08-11 11:45:59 on dist-test-slave-vkjp"
server_key: "1e2de8d7c3639db903aa761cc98c2ccd"
server_key_iv: "e8c97452d6cd3b20f4b498eef17803ad"
server_key_version: "encryptionkey@0"
I20260811 11:45:59.447634 853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:59.452134 853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:59.452715 853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:59.452903 853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:59.459712 853 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:40215
I20260811 11:45:59.459721 939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:40215 every 8 connection(s)
I20260811 11:45:59.460649 853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:45:59.463857 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 853
I20260811 11:45:59.463989 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:45:59.463996 940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:45:59.464322 21457 external_mini_cluster.cc:1428] Setting key 3407c2fde949b79329805c36e3a606e7
I20260811 11:45:59.470484 944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:59.465667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59838 (local address 127.20.244.126:40215)
0811 11:45:59.466324 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:59.466342 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:59.466383 (+ 41us) server_negotiation.cc:407] Connection header received
0811 11:45:59.467511 (+ 1128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:59.467537 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:59.467983 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:59.468335 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:59.469038 (+ 703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:59.469044 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:59.469057 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:59.469068 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:59.469132 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:59.469154 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:59.469294 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:59.469366 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 11:45:59.469602 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":103,"threads_started":1}
I20260811 11:45:59.471350 940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189: Bootstrap starting.
I20260811 11:45:59.473691 940 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189: Neither blocks nor log segments found. Creating new log.
I20260811 11:45:59.474370 940 log.cc:824] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189: Log is configured to *not* fsync() on all Append() calls
I20260811 11:45:59.476217 940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189: No bootstrap required, opened a new log
I20260811 11:45:59.479635 940 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ec5ed01d0054a96a5d4b1e5fdc7e189" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40215 } }
I20260811 11:45:59.479840 940 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:45:59.479875 940 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ec5ed01d0054a96a5d4b1e5fdc7e189, State: Initialized, Role: FOLLOWER
I20260811 11:45:59.480212 940 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ec5ed01d0054a96a5d4b1e5fdc7e189" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40215 } }
I20260811 11:45:59.480331 940 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:45:59.480376 940 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:45:59.480437 940 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:45:59.481226 940 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ec5ed01d0054a96a5d4b1e5fdc7e189" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40215 } }
I20260811 11:45:59.481514 940 leader_election.cc:302] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ec5ed01d0054a96a5d4b1e5fdc7e189; no voters:
I20260811 11:45:59.481763 940 leader_election.cc:288] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:45:59.481874 946 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:45:59.482137 946 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189 [term 1 LEADER]: Becoming Leader. State: Replica: 7ec5ed01d0054a96a5d4b1e5fdc7e189, State: Running, Role: LEADER
I20260811 11:45:59.482473 946 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ec5ed01d0054a96a5d4b1e5fdc7e189" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40215 } }
I20260811 11:45:59.482986 940 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:45:59.484228 950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ec5ed01d0054a96a5d4b1e5fdc7e189. Latest consensus state: current_term: 1 leader_uuid: "7ec5ed01d0054a96a5d4b1e5fdc7e189" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ec5ed01d0054a96a5d4b1e5fdc7e189" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40215 } } }
I20260811 11:45:59.484418 950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:59.484228 947 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ec5ed01d0054a96a5d4b1e5fdc7e189" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ec5ed01d0054a96a5d4b1e5fdc7e189" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40215 } } }
I20260811 11:45:59.484733 947 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189 [sys.catalog]: This master's current role is: LEADER
I20260811 11:45:59.484817 958 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:45:59.487479 958 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:45:59.493633 958 catalog_manager.cc:1347] Generated new cluster ID: 2515d7a4ace64dafbe5195564b2e0ba2
I20260811 11:45:59.493723 958 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:45:59.514004 958 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:45:59.514314 958 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:45:59.518724 958 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ec5ed01d0054a96a5d4b1e5fdc7e189: Generated new TSK 0
I20260811 11:45:59.519475 958 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:45:59.526357 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40215
--builtin_ntp_servers=127.20.244.84:34529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 11:45:59.642988 970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:59.643437 970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:59.643505 970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:59.647894 970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:59.647957 970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:59.648016 970 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:45:59.653131 970 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:34529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40215
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:59.654203 970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:59.655619 970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:59.665198 981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:59.665246 977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:59.665249 984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:59.665573 970 server_base.cc:1034] running on GCE node
I20260811 11:45:59.666045 970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:59.666761 970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:59.667927 970 hybrid_clock.cc:648] HybridClock initialized: now 1786448759667915 us; error 28 us; skew 500 ppm
I20260811 11:45:59.669891 970 webserver.cc:460] Webserver started at http://127.20.244.65:41699/ using document root <none> and password file <none>
I20260811 11:45:59.670486 970 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:59.670550 970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:59.670814 970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:59.672963 970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "49a323346263438aa2785c878da9255d"
format_stamp: "Formatted at 2026-08-11 11:45:59 on dist-test-slave-vkjp"
server_key: "57f16f2d4fac21bc2608d7379a0097d1"
server_key_iv: "e3398ce34aaa99a4148d7a1664278986"
server_key_version: "encryptionkey@0"
I20260811 11:45:59.673549 970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "49a323346263438aa2785c878da9255d"
format_stamp: "Formatted at 2026-08-11 11:45:59 on dist-test-slave-vkjp"
server_key: "57f16f2d4fac21bc2608d7379a0097d1"
server_key_iv: "e3398ce34aaa99a4148d7a1664278986"
server_key_version: "encryptionkey@0"
I20260811 11:45:59.677332 970 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 11:45:59.680022 990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:59.681326 970 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:45:59.681483 970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "49a323346263438aa2785c878da9255d"
format_stamp: "Formatted at 2026-08-11 11:45:59 on dist-test-slave-vkjp"
server_key: "57f16f2d4fac21bc2608d7379a0097d1"
server_key_iv: "e3398ce34aaa99a4148d7a1664278986"
server_key_version: "encryptionkey@0"
I20260811 11:45:59.681608 970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:59.686576 970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:59.687392 970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:59.687582 970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:59.688133 970 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:59.689081 970 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:59.689152 970 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:59.689215 970 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:59.689268 970 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:59.698313 970 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:41023
I20260811 11:45:59.698423 1133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:41023 every 8 connection(s)
I20260811 11:45:59.699360 970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:45:59.703435 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 970
I20260811 11:45:59.703590 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:45:59.703931 21457 external_mini_cluster.cc:1428] Setting key 7ddb450765860b960c22fd1db02abdfb
I20260811 11:45:59.706058 944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:59.701282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:33773 (local address 127.20.244.126:40215)
0811 11:45:59.701433 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:59.701436 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:59.702396 (+ 960us) server_negotiation.cc:407] Connection header received
0811 11:45:59.704049 (+ 1653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:59.704052 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:59.704100 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:59.704193 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:59.705609 (+ 1416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:59.705611 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:59.705613 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:59.705624 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:59.705644 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:59.705651 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:59.705724 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:59.705920 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 11:45:59.705956 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 11:45:59.706219 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40215
--builtin_ntp_servers=127.20.244.84:34529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 11:45:59.707216 1136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:59.701586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40215 (local address 127.20.244.65:33773)
0811 11:45:59.702235 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:59.702275 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:59.703774 (+ 1499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:59.704406 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:59.704413 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:59.704499 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:59.705105 (+ 606us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:45:59.705107 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:59.705158 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:45:59.705238 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:59.705748 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:59.705758 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:59.705765 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 11:45:59.705952 (+ 187us) client_negotiation.cc:240] Negotiation successful
0811 11:45:59.706194 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":114,"threads_started":1}
I20260811 11:45:59.708513 1134 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40215
I20260811 11:45:59.708740 1134 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:59.709173 1134 heartbeater.cc:511] Master 127.20.244.126:40215 requested a full tablet report, sending...
I20260811 11:45:59.710660 896 ts_manager.cc:194] Registered new tserver with Master: 49a323346263438aa2785c878da9255d (127.20.244.65:41023)
W20260811 11:45:59.819538 1137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:59.819833 1137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:59.819921 1137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:45:59.823999 1137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:45:59.824076 1137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:45:59.824163 1137 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:45:59.828917 1137 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:34529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40215
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:45:59.830030 1137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:45:59.831476 1137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:45:59.841102 1147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:59.841071 1145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:45:59.841091 1143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:45:59.841295 1137 server_base.cc:1034] running on GCE node
I20260811 11:45:59.841902 1137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:45:59.842587 1137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:45:59.843770 1137 hybrid_clock.cc:648] HybridClock initialized: now 1786448759843759 us; error 27 us; skew 500 ppm
I20260811 11:45:59.845592 1137 webserver.cc:460] Webserver started at http://127.20.244.66:46859/ using document root <none> and password file <none>
I20260811 11:45:59.846165 1137 fs_manager.cc:359] Metadata directory not provided
I20260811 11:45:59.846259 1137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:45:59.846498 1137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:45:59.848578 1137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "3b291ac97a6d45b19ce83caed02df8f5"
format_stamp: "Formatted at 2026-08-11 11:45:59 on dist-test-slave-vkjp"
server_key: "6a4fde96914bfe0487f81eb250878289"
server_key_iv: "22b45bbdc64b84dca1dfbc7fd9257676"
server_key_version: "encryptionkey@0"
I20260811 11:45:59.849159 1137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "3b291ac97a6d45b19ce83caed02df8f5"
format_stamp: "Formatted at 2026-08-11 11:45:59 on dist-test-slave-vkjp"
server_key: "6a4fde96914bfe0487f81eb250878289"
server_key_iv: "22b45bbdc64b84dca1dfbc7fd9257676"
server_key_version: "encryptionkey@0"
I20260811 11:45:59.853031 1137 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 11:45:59.855530 1154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:59.856720 1137 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:45:59.856858 1137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "3b291ac97a6d45b19ce83caed02df8f5"
format_stamp: "Formatted at 2026-08-11 11:45:59 on dist-test-slave-vkjp"
server_key: "6a4fde96914bfe0487f81eb250878289"
server_key_iv: "22b45bbdc64b84dca1dfbc7fd9257676"
server_key_version: "encryptionkey@0"
I20260811 11:45:59.856974 1137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:45:59.861580 1137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:45:59.862170 1137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:45:59.862352 1137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:45:59.862890 1137 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:45:59.863826 1137 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:45:59.863901 1137 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:59.863963 1137 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:45:59.864013 1137 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:45:59.873023 1137 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:37719
I20260811 11:45:59.873138 1292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:37719 every 8 connection(s)
I20260811 11:45:59.874151 1137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:45:59.880410 944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:59.876158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:57859 (local address 127.20.244.126:40215)
0811 11:45:59.876305 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 11:45:59.876310 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:45:59.877350 (+ 1040us) server_negotiation.cc:407] Connection header received
0811 11:45:59.878681 (+ 1331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:45:59.878685 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:45:59.878729 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:45:59.878846 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:45:59.879925 (+ 1079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:45:59.879929 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:45:59.879931 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:45:59.879950 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:45:59.879969 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:45:59.879978 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:45:59.880072 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 11:45:59.880228 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 11:45:59.880271 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 11:45:59.881227 1295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:45:59.876550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40215 (local address 127.20.244.66:57859)
0811 11:45:59.877178 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0811 11:45:59.877217 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 11:45:59.878471 (+ 1254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:45:59.879004 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:45:59.879011 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:45:59.879144 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:45:59.879666 (+ 522us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:45:59.879667 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:45:59.879705 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:45:59.879769 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:45:59.880068 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:45:59.880077 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:45:59.880084 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 11:45:59.880310 (+ 226us) client_negotiation.cc:240] Negotiation successful
0811 11:45:59.880542 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":114,"threads_started":1}
I20260811 11:45:59.882319 1293 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40215
I20260811 11:45:59.882542 1293 heartbeater.cc:464] Registering TS with master...
I20260811 11:45:59.882927 1293 heartbeater.cc:511] Master 127.20.244.126:40215 requested a full tablet report, sending...
I20260811 11:45:59.884065 896 ts_manager.cc:194] Registered new tserver with Master: 3b291ac97a6d45b19ce83caed02df8f5 (127.20.244.66:37719)
I20260811 11:45:59.884294 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 1137
I20260811 11:45:59.884428 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:45:59.884793 21457 external_mini_cluster.cc:1428] Setting key 4065f4bcbb61d42eadd234987aada8a3
I20260811 11:45:59.886657 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40215
--builtin_ntp_servers=127.20.244.84:34529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 11:45:59.998827 1296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:45:59.999171 1296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:45:59.999219 1296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:46:00.003247 1296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:46:00.003299 1296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:46:00.003355 1296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:46:00.008023 1296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:34529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40215
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:46:00.009048 1296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:46:00.010360 1296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:46:00.020036 1309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:46:00.020076 1303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:46:00.020076 1302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:46:00.020323 1296 server_base.cc:1034] running on GCE node
I20260811 11:46:00.020843 1296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:46:00.021440 1296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:46:00.022660 1296 hybrid_clock.cc:648] HybridClock initialized: now 1786448760022632 us; error 50 us; skew 500 ppm
I20260811 11:46:00.024606 1296 webserver.cc:460] Webserver started at http://127.20.244.67:45301/ using document root <none> and password file <none>
I20260811 11:46:00.025192 1296 fs_manager.cc:359] Metadata directory not provided
I20260811 11:46:00.025283 1296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:46:00.025532 1296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:46:00.027690 1296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "04b77822eae240499c12aa937c549a13"
format_stamp: "Formatted at 2026-08-11 11:46:00 on dist-test-slave-vkjp"
server_key: "44d61644c245701e40e1a48ced4becde"
server_key_iv: "ccc7a3c23de7e2f75683b090537f32f7"
server_key_version: "encryptionkey@0"
I20260811 11:46:00.028259 1296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "04b77822eae240499c12aa937c549a13"
format_stamp: "Formatted at 2026-08-11 11:46:00 on dist-test-slave-vkjp"
server_key: "44d61644c245701e40e1a48ced4becde"
server_key_iv: "ccc7a3c23de7e2f75683b090537f32f7"
server_key_version: "encryptionkey@0"
I20260811 11:46:00.032014 1296 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 11:46:00.034552 1316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:46:00.035838 1296 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:46:00.035976 1296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "04b77822eae240499c12aa937c549a13"
format_stamp: "Formatted at 2026-08-11 11:46:00 on dist-test-slave-vkjp"
server_key: "44d61644c245701e40e1a48ced4becde"
server_key_iv: "ccc7a3c23de7e2f75683b090537f32f7"
server_key_version: "encryptionkey@0"
I20260811 11:46:00.036091 1296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:46:00.040648 1296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:46:00.041265 1296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:46:00.041455 1296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:46:00.041991 1296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:46:00.042888 1296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:46:00.042959 1296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:46:00.043047 1296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:46:00.043114 1296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:46:00.052161 1296 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:42137
I20260811 11:46:00.052225 1449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:42137 every 8 connection(s)
I20260811 11:46:00.053073 1296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:46:00.053476 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 1296
I20260811 11:46:00.053612 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:46:00.053961 21457 external_mini_cluster.cc:1428] Setting key 6efc3c6ee86f5a346acb8ea6c761c6f4
I20260811 11:46:00.059901 944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:00.054966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:33753 (local address 127.20.244.126:40215)
0811 11:46:00.055161 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:00.055166 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:00.056417 (+ 1251us) server_negotiation.cc:407] Connection header received
0811 11:46:00.057823 (+ 1406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:00.057826 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:00.057870 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:00.057946 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:46:00.059407 (+ 1461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:46:00.059410 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:46:00.059412 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:46:00.059424 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:46:00.059444 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:46:00.059453 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:46:00.059537 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:00.059681 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 11:46:00.059737 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 11:46:00.060745 1452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:00.055518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40215 (local address 127.20.244.67:33753)
0811 11:46:00.056276 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0811 11:46:00.056317 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 11:46:00.057573 (+ 1256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:46:00.058254 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:46:00.058263 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:46:00.058420 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:46:00.059146 (+ 726us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:46:00.059149 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:46:00.059199 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:46:00.059266 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:46:00.059527 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:46:00.059531 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:46:00.059534 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:46:00.059669 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 11:46:00.059941 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":118,"threads_started":1}
I20260811 11:46:00.061818 1450 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40215
I20260811 11:46:00.062062 1450 heartbeater.cc:464] Registering TS with master...
I20260811 11:46:00.062491 1450 heartbeater.cc:511] Master 127.20.244.126:40215 requested a full tablet report, sending...
I20260811 11:46:00.063495 896 ts_manager.cc:194] Registered new tserver with Master: 04b77822eae240499c12aa937c549a13 (127.20.244.67:42137)
I20260811 11:46:00.067732 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 11:46:00.070439 944 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:46:00.069634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59846 (local address 127.20.244.126:40215)
0811 11:46:00.069756 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:00.069759 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:00.069898 (+ 139us) server_negotiation.cc:407] Connection header received
0811 11:46:00.069995 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:00.069998 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:00.070024 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:00.070086 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:46:00.070278 (+ 192us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59846: BlockingRecv error: recv got EOF from 127.0.0.1:59846 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 11:46:00.070618 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 970
I20260811 11:46:00.088356 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 1137
I20260811 11:46:00.096282 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 1296
I20260811 11:46:00.104578 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 853
2026-08-11T11:46:00Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (838 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:46:00 dist-test-slave-vkjp krb5kdc[1463](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:46:00 dist-test-slave-vkjp krb5kdc[1463](info): set up 2 sockets
Aug 11 11:46:00 dist-test-slave-vkjp krb5kdc[1463](info): commencing operation
krb5kdc: starting...
W20260811 11:46:01.231369 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:46:01 dist-test-slave-vkjp krb5kdc[1463](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448761, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:46:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:46:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:46:01.359299 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:36355
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:38985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:36355
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:46:01.476704 1479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:46:01.476985 1479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:46:01.477063 1479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:46:01.481207 1479 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:46:01.481289 1479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:46:01.481312 1479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:46:01.481333 1479 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:46:01.481350 1479 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:46:01.487037 1479 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:38985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:36355
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:36355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1479
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:46:01.488252 1479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:46:01.489343 1479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:46:01.498463 1488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:46:01.498472 1490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:46:01.498479 1487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:46:01.498854 1479 server_base.cc:1034] running on GCE node
I20260811 11:46:01.499635 1479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:46:01.500737 1479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:46:01.501901 1479 hybrid_clock.cc:648] HybridClock initialized: now 1786448761501872 us; error 46 us; skew 500 ppm
Aug 11 11:46:01 dist-test-slave-vkjp krb5kdc[1463](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448761, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:46:01.504827 1479 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:46:01.505774 1479 webserver.cc:460] Webserver started at http://127.20.244.126:37295/ using document root <none> and password file <none>
I20260811 11:46:01.506342 1479 fs_manager.cc:359] Metadata directory not provided
I20260811 11:46:01.506419 1479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:46:01.506675 1479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:46:01.508807 1479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "90655aca54c54ddd827b7b63ba61f94c"
format_stamp: "Formatted at 2026-08-11 11:46:01 on dist-test-slave-vkjp"
server_key: "c9a9122eaa08fe251cac3d80d31ab02d"
server_key_iv: "b7adcb29ff73b5dd3e5865d36ac4a564"
server_key_version: "encryptionkey@0"
I20260811 11:46:01.509399 1479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "90655aca54c54ddd827b7b63ba61f94c"
format_stamp: "Formatted at 2026-08-11 11:46:01 on dist-test-slave-vkjp"
server_key: "c9a9122eaa08fe251cac3d80d31ab02d"
server_key_iv: "b7adcb29ff73b5dd3e5865d36ac4a564"
server_key_version: "encryptionkey@0"
I20260811 11:46:01.513494 1479 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260811 11:46:01.516249 1499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:46:01.517614 1479 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:46:01.517767 1479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "90655aca54c54ddd827b7b63ba61f94c"
format_stamp: "Formatted at 2026-08-11 11:46:01 on dist-test-slave-vkjp"
server_key: "c9a9122eaa08fe251cac3d80d31ab02d"
server_key_iv: "b7adcb29ff73b5dd3e5865d36ac4a564"
server_key_version: "encryptionkey@0"
I20260811 11:46:01.517901 1479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:46:01.531800 1479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:46:01.534710 1479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:46:01.534917 1479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:46:01.542272 1479 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:36355
I20260811 11:46:01.542407 1557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:36355 every 8 connection(s)
I20260811 11:46:01.543345 1479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:46:01.546381 1558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:46:01.546527 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 1479
I20260811 11:46:01.546677 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:46:01.546969 21457 external_mini_cluster.cc:1428] Setting key e38338048022d40f368617aaf9309a07
I20260811 11:46:01.553941 1558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c: Bootstrap starting.
I20260811 11:46:01.556659 1558 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c: Neither blocks nor log segments found. Creating new log.
Aug 11 11:46:01 dist-test-slave-vkjp krb5kdc[1463](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448761, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:46:01.557590 1558 log.cc:824] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c: Log is configured to *not* fsync() on all Append() calls
I20260811 11:46:01.559865 1558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c: No bootstrap required, opened a new log
I20260811 11:46:01.562677 1561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:01.548419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35828 (local address 127.20.244.126:36355)
0811 11:46:01.548845 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:01.548864 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:01.548908 (+ 44us) server_negotiation.cc:407] Connection header received
0811 11:46:01.550013 (+ 1105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:01.550037 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:01.550455 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:01.550879 (+ 424us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:46:01.551592 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:01.553111 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:01.553935 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:01.554590 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:01.554745 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:01.557455 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:46:01.557460 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:46:01.557473 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:46:01.557499 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:46:01.559477 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:46:01.559930 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:46:01.559936 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:46:01.559942 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:46:01.560100 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:46:01.560385 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:46:01.560388 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:46:01.560389 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:46:01.560909 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:46:01.561109 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:01.561343 (+ 234us) server_negotiation.cc:299] Negotiation successful
0811 11:46:01.561630 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":102,"threads_started":1}
I20260811 11:46:01.564416 1558 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90655aca54c54ddd827b7b63ba61f94c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 36355 } }
I20260811 11:46:01.564663 1558 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:46:01.564718 1558 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90655aca54c54ddd827b7b63ba61f94c, State: Initialized, Role: FOLLOWER
I20260811 11:46:01.565171 1558 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90655aca54c54ddd827b7b63ba61f94c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 36355 } }
I20260811 11:46:01.565330 1558 raft_consensus.cc:388] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:46:01.565424 1558 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:46:01.565526 1558 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:46:01.566412 1558 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90655aca54c54ddd827b7b63ba61f94c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 36355 } }
I20260811 11:46:01.566745 1558 leader_election.cc:302] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90655aca54c54ddd827b7b63ba61f94c; no voters:
I20260811 11:46:01.567054 1558 leader_election.cc:288] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:46:01.567214 1563 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:46:01.567584 1563 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c [term 1 LEADER]: Becoming Leader. State: Replica: 90655aca54c54ddd827b7b63ba61f94c, State: Running, Role: LEADER
I20260811 11:46:01.567909 1563 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90655aca54c54ddd827b7b63ba61f94c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 36355 } }
I20260811 11:46:01.568356 1558 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:46:01.569957 1565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90655aca54c54ddd827b7b63ba61f94c. Latest consensus state: current_term: 1 leader_uuid: "90655aca54c54ddd827b7b63ba61f94c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90655aca54c54ddd827b7b63ba61f94c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 36355 } } }
I20260811 11:46:01.570107 1565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c [sys.catalog]: This master's current role is: LEADER
I20260811 11:46:01.570477 1564 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "90655aca54c54ddd827b7b63ba61f94c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90655aca54c54ddd827b7b63ba61f94c" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 36355 } } }
I20260811 11:46:01.570812 1564 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c [sys.catalog]: This master's current role is: LEADER
I20260811 11:46:01.570928 1578 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:46:01.573585 1578 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:46:01.579484 1578 catalog_manager.cc:1347] Generated new cluster ID: 01780ec9bdee4835a1dd22cce2408e36
I20260811 11:46:01.579594 1578 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:46:01.590806 1578 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:46:01.592200 1578 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:46:01.599273 1578 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c: Generated new TSK 0
I20260811 11:46:01.600024 1578 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.244.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
I20260811 11:46:01.643205 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:36355
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:38985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:46:01.789568 1588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:46:01.789883 1588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:46:01.789930 1588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:46:01.794349 1588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:46:01.794426 1588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:46:01.794516 1588 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:46:01.800175 1588 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:38985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:36355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1588
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:46:01.801507 1588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:46:01.802596 1588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:46:01.812804 1596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:46:01.812814 1594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:46:01.812835 1598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:46:01.813107 1588 server_base.cc:1034] running on GCE node
I20260811 11:46:01.813545 1588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:46:01.814276 1588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:46:01.815474 1588 hybrid_clock.cc:648] HybridClock initialized: now 1786448761815455 us; error 30 us; skew 500 ppm
Aug 11 11:46:01 dist-test-slave-vkjp krb5kdc[1463](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448761, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:46:01.818532 1588 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:46:01.819558 1588 webserver.cc:460] Webserver started at http://127.20.244.65:33251/ using document root <none> and password file <none>
I20260811 11:46:01.820117 1588 fs_manager.cc:359] Metadata directory not provided
I20260811 11:46:01.820178 1588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:46:01.820355 1588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:46:01.822782 1588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "fbd77ca9b1f94911b9bb9bc2162f367e"
format_stamp: "Formatted at 2026-08-11 11:46:01 on dist-test-slave-vkjp"
server_key: "46f90b2c3236b9a48a59c44dd8d82ec3"
server_key_iv: "89158582242fdfea6ca29bb263480643"
server_key_version: "encryptionkey@0"
I20260811 11:46:01.823426 1588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "fbd77ca9b1f94911b9bb9bc2162f367e"
format_stamp: "Formatted at 2026-08-11 11:46:01 on dist-test-slave-vkjp"
server_key: "46f90b2c3236b9a48a59c44dd8d82ec3"
server_key_iv: "89158582242fdfea6ca29bb263480643"
server_key_version: "encryptionkey@0"
I20260811 11:46:01.827404 1588 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 11:46:01.829965 1608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:46:01.831393 1588 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:46:01.831506 1588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "fbd77ca9b1f94911b9bb9bc2162f367e"
format_stamp: "Formatted at 2026-08-11 11:46:01 on dist-test-slave-vkjp"
server_key: "46f90b2c3236b9a48a59c44dd8d82ec3"
server_key_iv: "89158582242fdfea6ca29bb263480643"
server_key_version: "encryptionkey@0"
I20260811 11:46:01.831607 1588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:46:01.872361 1588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:46:01.875985 1588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:46:01.876214 1588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:46:01.876878 1588 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:46:01.877763 1588 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:46:01.877812 1588 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:46:01.877882 1588 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:46:01.877913 1588 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:46:01.887557 1588 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:36879
I20260811 11:46:01.887578 1742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:36879 every 8 connection(s)
I20260811 11:46:01.888569 1588 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:46:01.892848 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 1588
I20260811 11:46:01.892956 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:46:01.893244 21457 external_mini_cluster.cc:1428] Setting key 6cd32106181c938ea073ee67f2f204e9
Aug 11 11:46:01 dist-test-slave-vkjp krb5kdc[1463](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448761, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.244.66@KRBTEST.COM; defaulting to no policy
I20260811 11:46:01.904767 1561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:01.890557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:37671 (local address 127.20.244.126:36355)
0811 11:46:01.890714 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:01.890718 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:01.891671 (+ 953us) server_negotiation.cc:407] Connection header received
0811 11:46:01.893080 (+ 1409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:01.893083 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:01.893144 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:01.893225 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:46:01.894645 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:01.895327 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:01.896585 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:01.896842 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:01.896973 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:01.900005 (+ 3032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:46:01.900013 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:46:01.900019 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:46:01.900059 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:46:01.901782 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:46:01.902534 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:46:01.902537 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:46:01.902538 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:46:01.902633 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:46:01.903237 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:46:01.903242 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:46:01.903244 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:46:01.903491 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:46:01.903586 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:01.904423 (+ 837us) server_negotiation.cc:299] Negotiation successful
0811 11:46:01.904608 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 11:46:01.905766 1748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:01.890965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:36355 (local address 127.20.244.65:37671)
0811 11:46:01.891499 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0811 11:46:01.891547 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 11:46:01.892820 (+ 1273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:46:01.893421 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:46:01.893429 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:46:01.893931 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:46:01.894466 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:01.894481 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:01.895458 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:01.895464 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:01.896438 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:01.896448 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:01.897028 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:01.897033 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:01.897226 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:01.897899 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:46:01.897917 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:46:01.899738 (+ 1821us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:46:01.901944 (+ 2206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:46:01.901953 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:46:01.901978 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:46:01.902402 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:46:01.902757 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:46:01.902762 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:46:01.902765 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:46:01.902992 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:46:01.903621 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:46:01.903632 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:46:01.904052 (+ 420us) client_negotiation.cc:769] Sending connection context
0811 11:46:01.904290 (+ 238us) client_negotiation.cc:240] Negotiation successful
0811 11:46:01.904734 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":135,"threads_started":1}
I20260811 11:46:01.907310 1744 heartbeater.cc:347] Connected to a master server at 127.20.244.126:36355
I20260811 11:46:01.907593 1744 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.66@KRBTEST.COM" created.
I20260811 11:46:01.908290 1744 heartbeater.cc:511] Master 127.20.244.126:36355 requested a full tablet report, sending...
I20260811 11:46:01.910050 1519 ts_manager.cc:194] Registered new tserver with Master: fbd77ca9b1f94911b9bb9bc2162f367e (127.20.244.65:36879)
I20260811 11:46:01.911331 1519 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:37671
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
I20260811 11:46:01.927660 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:36355
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:38985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:46:02.043669 1751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:46:02.043988 1751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:46:02.044072 1751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:46:02.048066 1751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:46:02.048161 1751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:46:02.048255 1751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:46:02.053562 1751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:38985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:36355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:46:02.054698 1751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:46:02.055775 1751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:46:02.065959 1761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:46:02.066010 1762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:46:02.066226 1751 server_base.cc:1034] running on GCE node
W20260811 11:46:02.065959 1764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:46:02.066784 1751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:46:02.067567 1751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:46:02.068735 1751 hybrid_clock.cc:648] HybridClock initialized: now 1786448762068714 us; error 29 us; skew 500 ppm
Aug 11 11:46:02 dist-test-slave-vkjp krb5kdc[1463](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448762, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:46:02.071944 1751 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:46:02.072923 1751 webserver.cc:460] Webserver started at http://127.20.244.66:35545/ using document root <none> and password file <none>
I20260811 11:46:02.073529 1751 fs_manager.cc:359] Metadata directory not provided
I20260811 11:46:02.073626 1751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:46:02.073869 1751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:46:02.076057 1751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "362f5c53e8a94ec3b85ab99e0f384acf"
format_stamp: "Formatted at 2026-08-11 11:46:02 on dist-test-slave-vkjp"
server_key: "fc331ad93bd891f6cb9b54912a40d67c"
server_key_iv: "b8847f63fb24f23e4f00c4f40865e4e4"
server_key_version: "encryptionkey@0"
I20260811 11:46:02.076655 1751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "362f5c53e8a94ec3b85ab99e0f384acf"
format_stamp: "Formatted at 2026-08-11 11:46:02 on dist-test-slave-vkjp"
server_key: "fc331ad93bd891f6cb9b54912a40d67c"
server_key_iv: "b8847f63fb24f23e4f00c4f40865e4e4"
server_key_version: "encryptionkey@0"
I20260811 11:46:02.080502 1751 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 11:46:02.082979 1773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:46:02.084223 1751 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:46:02.084360 1751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "362f5c53e8a94ec3b85ab99e0f384acf"
format_stamp: "Formatted at 2026-08-11 11:46:02 on dist-test-slave-vkjp"
server_key: "fc331ad93bd891f6cb9b54912a40d67c"
server_key_iv: "b8847f63fb24f23e4f00c4f40865e4e4"
server_key_version: "encryptionkey@0"
I20260811 11:46:02.084491 1751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:46:02.102473 1751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:46:02.106066 1751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:46:02.106289 1751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:46:02.106984 1751 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:46:02.107889 1751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:46:02.107960 1751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:46:02.108035 1751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:46:02.108078 1751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:46:02.117278 1751 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:44941
I20260811 11:46:02.117296 1930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:44941 every 8 connection(s)
I20260811 11:46:02.118227 1751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:46:02.126195 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 1751
I20260811 11:46:02.126322 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:46:02.126686 21457 external_mini_cluster.cc:1428] Setting key d61930f311f2bbdce1b17ebb006afc56
Aug 11 11:46:02 dist-test-slave-vkjp krb5kdc[1463](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448762, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:46:02.133229 1561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:02.120185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:49495 (local address 127.20.244.126:36355)
0811 11:46:02.120333 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:02.120337 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:02.121248 (+ 911us) server_negotiation.cc:407] Connection header received
0811 11:46:02.122788 (+ 1540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:02.122791 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:02.122852 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:02.122961 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:46:02.124203 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.124746 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.125913 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.126269 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.126402 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:02.129038 (+ 2636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:46:02.129045 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:46:02.129052 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:46:02.129087 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:46:02.130773 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:46:02.131483 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:46:02.131486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:46:02.131487 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:46:02.131582 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:46:02.132002 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:46:02.132004 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:46:02.132005 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:46:02.132189 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:46:02.132266 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:02.132970 (+ 704us) server_negotiation.cc:299] Negotiation successful
0811 11:46:02.133089 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 11:46:02.134441 1934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:02.120563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:36355 (local address 127.20.244.66:49495)
0811 11:46:02.121094 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0811 11:46:02.121140 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 11:46:02.122566 (+ 1426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:46:02.123186 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:46:02.123193 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:46:02.123562 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:46:02.124054 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:02.124067 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.124881 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.124889 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:02.125770 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:02.125779 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.126508 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.126512 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:02.126679 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:02.127377 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:46:02.127395 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:46:02.128866 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:46:02.130899 (+ 2033us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:46:02.130908 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:46:02.130929 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:46:02.131363 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:46:02.131696 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:46:02.131701 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:46:02.131704 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:46:02.131898 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:46:02.132298 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:46:02.132308 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:46:02.132664 (+ 356us) client_negotiation.cc:769] Sending connection context
0811 11:46:02.132879 (+ 215us) client_negotiation.cc:240] Negotiation successful
0811 11:46:02.133256 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":130,"threads_started":1}
I20260811 11:46:02.135869 1931 heartbeater.cc:347] Connected to a master server at 127.20.244.126:36355
I20260811 11:46:02.136142 1931 heartbeater.cc:464] Registering TS with master...
I20260811 11:46:02.136761 1931 heartbeater.cc:511] Master 127.20.244.126:36355 requested a full tablet report, sending...
I20260811 11:46:02.137921 1519 ts_manager.cc:194] Registered new tserver with Master: 362f5c53e8a94ec3b85ab99e0f384acf (127.20.244.66:44941)
WARNING: no policy specified for kudu/127.20.244.67@KRBTEST.COM; defaulting to no policy
I20260811 11:46:02.138595 1519 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:49495
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
I20260811 11:46:02.159361 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:36355
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:38985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:46:02.276747 1938 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:46:02.277079 1938 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:46:02.277166 1938 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:46:02.281428 1938 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:46:02.281544 1938 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:46:02.281642 1938 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:46:02.287289 1938 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:38985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:36355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1938
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:46:02.288548 1938 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:46:02.289625 1938 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:46:02.299527 1946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:46:02.299628 1938 server_base.cc:1034] running on GCE node
W20260811 11:46:02.299521 1948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:46:02.299535 1945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:46:02.300151 1938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:46:02.300904 1938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:46:02.302102 1938 hybrid_clock.cc:648] HybridClock initialized: now 1786448762302087 us; error 29 us; skew 500 ppm
Aug 11 11:46:02 dist-test-slave-vkjp krb5kdc[1463](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448762, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:46:02.305178 1938 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:46:02.306197 1938 webserver.cc:460] Webserver started at http://127.20.244.67:45657/ using document root <none> and password file <none>
I20260811 11:46:02.306792 1938 fs_manager.cc:359] Metadata directory not provided
I20260811 11:46:02.306879 1938 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:46:02.307174 1938 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:46:02.309363 1938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "3479081942d44e4fbf0e73a44d2c6356"
format_stamp: "Formatted at 2026-08-11 11:46:02 on dist-test-slave-vkjp"
server_key: "75f5461c5e11bff2a8a4c2906d895957"
server_key_iv: "5427dad4994a61fe32826cb7a0c9b0eb"
server_key_version: "encryptionkey@0"
I20260811 11:46:02.309970 1938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "3479081942d44e4fbf0e73a44d2c6356"
format_stamp: "Formatted at 2026-08-11 11:46:02 on dist-test-slave-vkjp"
server_key: "75f5461c5e11bff2a8a4c2906d895957"
server_key_iv: "5427dad4994a61fe32826cb7a0c9b0eb"
server_key_version: "encryptionkey@0"
I20260811 11:46:02.314090 1938 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260811 11:46:02.316813 1955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:46:02.318182 1938 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 11:46:02.318307 1938 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "3479081942d44e4fbf0e73a44d2c6356"
format_stamp: "Formatted at 2026-08-11 11:46:02 on dist-test-slave-vkjp"
server_key: "75f5461c5e11bff2a8a4c2906d895957"
server_key_iv: "5427dad4994a61fe32826cb7a0c9b0eb"
server_key_version: "encryptionkey@0"
I20260811 11:46:02.318435 1938 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:46:02.333415 1938 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:46:02.337128 1938 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:46:02.337360 1938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:46:02.338007 1938 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:46:02.338891 1938 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:46:02.338938 1938 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:46:02.339005 1938 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:46:02.339041 1938 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:46:02.348937 1938 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:42283
I20260811 11:46:02.348959 2094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:42283 every 8 connection(s)
I20260811 11:46:02.349891 1938 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:46:02.357515 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 1938
I20260811 11:46:02.357671 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:46:02.357997 21457 external_mini_cluster.cc:1428] Setting key 5fdf6c36743b95d8828ee8ba47a3737d
Aug 11 11:46:02 dist-test-slave-vkjp krb5kdc[1463](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448762, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:46:02.364905 1561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:02.351941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:44507 (local address 127.20.244.126:36355)
0811 11:46:02.352093 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:02.352097 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:02.352946 (+ 849us) server_negotiation.cc:407] Connection header received
0811 11:46:02.354420 (+ 1474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:02.354424 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:02.354489 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:02.354600 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:46:02.355884 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.356442 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.357847 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.358143 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.358242 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:02.361310 (+ 3068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:46:02.361313 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:46:02.361315 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:46:02.361342 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:46:02.362726 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:46:02.363334 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:46:02.363337 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:46:02.363339 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:46:02.363447 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:46:02.363772 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:46:02.363774 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:46:02.363775 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:46:02.363967 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:46:02.364044 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:02.364638 (+ 594us) server_negotiation.cc:299] Negotiation successful
0811 11:46:02.364773 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 11:46:02.365713 2097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:02.352316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:36355 (local address 127.20.244.67:44507)
0811 11:46:02.352778 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0811 11:46:02.352822 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:46:02.354164 (+ 1342us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:46:02.354782 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:46:02.354789 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:46:02.355244 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:46:02.355736 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:02.355749 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.356575 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.356583 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:02.357720 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:02.357732 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.358321 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.358326 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:02.358511 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:02.359335 (+ 824us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:46:02.359354 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:46:02.361123 (+ 1769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:46:02.362847 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:46:02.362853 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:46:02.362869 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:46:02.363242 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:46:02.363535 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:46:02.363537 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:46:02.363538 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:46:02.363684 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:46:02.364054 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:46:02.364060 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:46:02.364341 (+ 281us) client_negotiation.cc:769] Sending connection context
0811 11:46:02.364509 (+ 168us) client_negotiation.cc:240] Negotiation successful
0811 11:46:02.364814 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":124,"threads_started":1}
I20260811 11:46:02.366895 2095 heartbeater.cc:347] Connected to a master server at 127.20.244.126:36355
I20260811 11:46:02.367183 2095 heartbeater.cc:464] Registering TS with master...
I20260811 11:46:02.367652 2095 heartbeater.cc:511] Master 127.20.244.126:36355 requested a full tablet report, sending...
I20260811 11:46:02.368775 1519 ts_manager.cc:194] Registered new tserver with Master: 3479081942d44e4fbf0e73a44d2c6356 (127.20.244.67:42283)
I20260811 11:46:02.369530 1519 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:44507
I20260811 11:46:02.372754 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:46:02.383193 1561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:02.375007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35838 (local address 127.20.244.126:36355)
0811 11:46:02.375195 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:02.375199 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:02.375704 (+ 505us) server_negotiation.cc:407] Connection header received
0811 11:46:02.375840 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:02.375842 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:02.375898 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:02.375978 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:46:02.376754 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.377342 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.378215 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.378446 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.378534 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:02.380082 (+ 1548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:46:02.380085 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:46:02.380087 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:46:02.380113 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:46:02.381459 (+ 1346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:46:02.381871 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:46:02.381874 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:46:02.381875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:46:02.381958 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:46:02.382223 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:46:02.382226 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:46:02.382227 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:46:02.382466 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:46:02.382575 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:02.382825 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 11:46:02.382938 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 11:46:02.386229 1519 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35838:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:46:02.389541 1519 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:46:02.405853 2108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:02.398367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:42283 (local address 127.0.0.1:34204)
0811 11:46:02.398982 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0811 11:46:02.399037 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 11:46:02.399210 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:46:02.400182 (+ 972us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:46:02.400188 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:46:02.400215 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:46:02.400465 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:02.400474 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.403178 (+ 2704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.403182 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:02.404145 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:02.404157 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.405235 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.405239 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:02.405374 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:02.405413 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 11:46:02.405510 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 11:46:02.405615 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"mutex_wait_us":116,"spinlock_wait_cycles":17024,"thread_start_us":156,"threads_started":1}
I20260811 11:46:02.405997 2113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:02.398992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52166 (local address 127.20.244.65:36879)
0811 11:46:02.399520 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:02.399539 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:02.399563 (+ 24us) server_negotiation.cc:407] Connection header received
0811 11:46:02.399720 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:02.399726 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:02.399931 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:02.400083 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:46:02.400631 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.401855 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.403895 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.404779 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.404896 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:02.405042 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:02.405712 (+ 670us) server_negotiation.cc:299] Negotiation successful
0811 11:46:02.405838 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":111,"threads_started":1}
I20260811 11:46:02.406241 2114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:02.398992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34204 (local address 127.20.244.67:42283)
0811 11:46:02.399761 (+ 769us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:02.399772 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:02.399791 (+ 19us) server_negotiation.cc:407] Connection header received
0811 11:46:02.399856 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:02.399860 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:02.400011 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:02.400379 (+ 368us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:46:02.402035 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.403028 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.404286 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.405083 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.405221 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:02.405351 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:02.405958 (+ 607us) server_negotiation.cc:299] Negotiation successful
0811 11:46:02.406073 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":675,"thread_start_us":210,"threads_started":1}
I20260811 11:46:02.406371 2112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:02.398581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:36879 (local address 127.0.0.1:52166)
0811 11:46:02.399458 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0811 11:46:02.399471 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:46:02.399561 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:46:02.400245 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:46:02.400248 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:46:02.400260 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:46:02.400467 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:02.400477 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.402021 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.402025 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:02.403738 (+ 1713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:02.403750 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.405115 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.405122 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:02.405226 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:02.405273 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 11:46:02.405402 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 11:46:02.405576 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":818,"mutex_wait_us":220,"thread_start_us":91,"threads_started":1}
I20260811 11:46:02.406853 2109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:02.398177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:44941 (local address 127.0.0.1:38124)
0811 11:46:02.398982 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0811 11:46:02.399038 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 11:46:02.399453 (+ 415us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:46:02.400227 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:46:02.400230 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:46:02.400247 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:46:02.400465 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:02.400474 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.402021 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.402025 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:02.403853 (+ 1828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:02.403862 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.404863 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.404867 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:02.406549 (+ 1682us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:02.406586 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 11:46:02.406663 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 11:46:02.406732 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"mutex_wait_us":124,"thread_start_us":83,"threads_started":1}
I20260811 11:46:02.407402 2111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:02.398465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38124 (local address 127.20.244.66:44941)
0811 11:46:02.399327 (+ 862us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:02.399339 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:02.399373 (+ 34us) server_negotiation.cc:407] Connection header received
0811 11:46:02.399627 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:02.399633 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:02.399856 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:02.400021 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:46:02.400592 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.401839 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.403957 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.404720 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.404850 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:02.405020 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:02.407127 (+ 2107us) server_negotiation.cc:299] Negotiation successful
0811 11:46:02.407244 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":738,"thread_start_us":103,"threads_started":1}
I20260811 11:46:02.409626 1834 tablet_service.cc:1467] Processing CreateTablet for tablet ba7fce8acd0444d0864dfe30024b0460 (DEFAULT_TABLE table=test-table [id=9596849e79994912b050445019f7963e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:46:02.409529 1666 tablet_service.cc:1467] Processing CreateTablet for tablet ba7fce8acd0444d0864dfe30024b0460 (DEFAULT_TABLE table=test-table [id=9596849e79994912b050445019f7963e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:46:02.409529 2009 tablet_service.cc:1467] Processing CreateTablet for tablet ba7fce8acd0444d0864dfe30024b0460 (DEFAULT_TABLE table=test-table [id=9596849e79994912b050445019f7963e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:46:02.410651 1834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba7fce8acd0444d0864dfe30024b0460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:46:02.410677 1666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba7fce8acd0444d0864dfe30024b0460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:46:02.411362 2009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba7fce8acd0444d0864dfe30024b0460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:46:02.417273 2115 tablet_bootstrap.cc:492] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf: Bootstrap starting.
I20260811 11:46:02.418541 2116 tablet_bootstrap.cc:492] T ba7fce8acd0444d0864dfe30024b0460 P fbd77ca9b1f94911b9bb9bc2162f367e: Bootstrap starting.
I20260811 11:46:02.418931 2117 tablet_bootstrap.cc:492] T ba7fce8acd0444d0864dfe30024b0460 P 3479081942d44e4fbf0e73a44d2c6356: Bootstrap starting.
I20260811 11:46:02.420064 2115 tablet_bootstrap.cc:654] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf: Neither blocks nor log segments found. Creating new log.
I20260811 11:46:02.420816 2117 tablet_bootstrap.cc:654] T ba7fce8acd0444d0864dfe30024b0460 P 3479081942d44e4fbf0e73a44d2c6356: Neither blocks nor log segments found. Creating new log.
I20260811 11:46:02.421025 2115 log.cc:824] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf: Log is configured to *not* fsync() on all Append() calls
I20260811 11:46:02.422163 2117 log.cc:824] T ba7fce8acd0444d0864dfe30024b0460 P 3479081942d44e4fbf0e73a44d2c6356: Log is configured to *not* fsync() on all Append() calls
I20260811 11:46:02.423830 2115 tablet_bootstrap.cc:492] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf: No bootstrap required, opened a new log
I20260811 11:46:02.423868 2116 tablet_bootstrap.cc:654] T ba7fce8acd0444d0864dfe30024b0460 P fbd77ca9b1f94911b9bb9bc2162f367e: Neither blocks nor log segments found. Creating new log.
I20260811 11:46:02.424058 2115 ts_tablet_manager.cc:1397] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 11:46:02.424214 2117 tablet_bootstrap.cc:492] T ba7fce8acd0444d0864dfe30024b0460 P 3479081942d44e4fbf0e73a44d2c6356: No bootstrap required, opened a new log
I20260811 11:46:02.424414 2117 ts_tablet_manager.cc:1397] T ba7fce8acd0444d0864dfe30024b0460 P 3479081942d44e4fbf0e73a44d2c6356: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 11:46:02.424753 2116 log.cc:824] T ba7fce8acd0444d0864dfe30024b0460 P fbd77ca9b1f94911b9bb9bc2162f367e: Log is configured to *not* fsync() on all Append() calls
I20260811 11:46:02.426954 2116 tablet_bootstrap.cc:492] T ba7fce8acd0444d0864dfe30024b0460 P fbd77ca9b1f94911b9bb9bc2162f367e: No bootstrap required, opened a new log
I20260811 11:46:02.427182 2116 ts_tablet_manager.cc:1397] T ba7fce8acd0444d0864dfe30024b0460 P fbd77ca9b1f94911b9bb9bc2162f367e: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260811 11:46:02.427757 2117 raft_consensus.cc:348] T ba7fce8acd0444d0864dfe30024b0460 P 3479081942d44e4fbf0e73a44d2c6356 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "362f5c53e8a94ec3b85ab99e0f384acf" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44941 } } peers { permanent_uuid: "3479081942d44e4fbf0e73a44d2c6356" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 42283 } } peers { permanent_uuid: "fbd77ca9b1f94911b9bb9bc2162f367e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 36879 } }
I20260811 11:46:02.428011 2117 raft_consensus.cc:374] T ba7fce8acd0444d0864dfe30024b0460 P 3479081942d44e4fbf0e73a44d2c6356 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:46:02.428085 2117 raft_consensus.cc:729] T ba7fce8acd0444d0864dfe30024b0460 P 3479081942d44e4fbf0e73a44d2c6356 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3479081942d44e4fbf0e73a44d2c6356, State: Initialized, Role: FOLLOWER
I20260811 11:46:02.428093 2115 raft_consensus.cc:348] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "362f5c53e8a94ec3b85ab99e0f384acf" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44941 } } peers { permanent_uuid: "3479081942d44e4fbf0e73a44d2c6356" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 42283 } } peers { permanent_uuid: "fbd77ca9b1f94911b9bb9bc2162f367e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 36879 } }
I20260811 11:46:02.428387 2115 raft_consensus.cc:374] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:46:02.428459 2115 raft_consensus.cc:729] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 362f5c53e8a94ec3b85ab99e0f384acf, State: Initialized, Role: FOLLOWER
I20260811 11:46:02.428627 2117 consensus_queue.cc:260] T ba7fce8acd0444d0864dfe30024b0460 P 3479081942d44e4fbf0e73a44d2c6356 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "362f5c53e8a94ec3b85ab99e0f384acf" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44941 } } peers { permanent_uuid: "3479081942d44e4fbf0e73a44d2c6356" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 42283 } } peers { permanent_uuid: "fbd77ca9b1f94911b9bb9bc2162f367e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 36879 } }
I20260811 11:46:02.429009 2115 consensus_queue.cc:260] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "362f5c53e8a94ec3b85ab99e0f384acf" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44941 } } peers { permanent_uuid: "3479081942d44e4fbf0e73a44d2c6356" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 42283 } } peers { permanent_uuid: "fbd77ca9b1f94911b9bb9bc2162f367e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 36879 } }
I20260811 11:46:02.429692 2117 ts_tablet_manager.cc:1428] T ba7fce8acd0444d0864dfe30024b0460 P 3479081942d44e4fbf0e73a44d2c6356: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260811 11:46:02.430054 2115 ts_tablet_manager.cc:1428] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 11:46:02.430078 2095 heartbeater.cc:503] Master 127.20.244.126:36355 was elected leader, sending a full tablet report...
I20260811 11:46:02.430437 1931 heartbeater.cc:503] Master 127.20.244.126:36355 was elected leader, sending a full tablet report...
I20260811 11:46:02.431536 2116 raft_consensus.cc:348] T ba7fce8acd0444d0864dfe30024b0460 P fbd77ca9b1f94911b9bb9bc2162f367e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "362f5c53e8a94ec3b85ab99e0f384acf" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44941 } } peers { permanent_uuid: "3479081942d44e4fbf0e73a44d2c6356" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 42283 } } peers { permanent_uuid: "fbd77ca9b1f94911b9bb9bc2162f367e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 36879 } }
I20260811 11:46:02.431813 2116 raft_consensus.cc:374] T ba7fce8acd0444d0864dfe30024b0460 P fbd77ca9b1f94911b9bb9bc2162f367e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:46:02.431883 2116 raft_consensus.cc:729] T ba7fce8acd0444d0864dfe30024b0460 P fbd77ca9b1f94911b9bb9bc2162f367e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbd77ca9b1f94911b9bb9bc2162f367e, State: Initialized, Role: FOLLOWER
I20260811 11:46:02.432310 2116 consensus_queue.cc:260] T ba7fce8acd0444d0864dfe30024b0460 P fbd77ca9b1f94911b9bb9bc2162f367e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "362f5c53e8a94ec3b85ab99e0f384acf" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44941 } } peers { permanent_uuid: "3479081942d44e4fbf0e73a44d2c6356" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 42283 } } peers { permanent_uuid: "fbd77ca9b1f94911b9bb9bc2162f367e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 36879 } }
I20260811 11:46:02.432998 1744 heartbeater.cc:503] Master 127.20.244.126:36355 was elected leader, sending a full tablet report...
I20260811 11:46:02.433276 2116 ts_tablet_manager.cc:1428] T ba7fce8acd0444d0864dfe30024b0460 P fbd77ca9b1f94911b9bb9bc2162f367e: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260811 11:46:02.600958 2096 tablet.cc:2369] T ba7fce8acd0444d0864dfe30024b0460 P 3479081942d44e4fbf0e73a44d2c6356: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:46:02.619462 1932 tablet.cc:2369] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:46:02.640153 1746 tablet.cc:2369] T ba7fce8acd0444d0864dfe30024b0460 P fbd77ca9b1f94911b9bb9bc2162f367e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:46:02.773061 2122 raft_consensus.cc:482] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:46:02.773342 2122 raft_consensus.cc:504] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "362f5c53e8a94ec3b85ab99e0f384acf" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44941 } } peers { permanent_uuid: "3479081942d44e4fbf0e73a44d2c6356" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 42283 } } peers { permanent_uuid: "fbd77ca9b1f94911b9bb9bc2162f367e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 36879 } }
I20260811 11:46:02.774645 2122 leader_election.cc:288] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3479081942d44e4fbf0e73a44d2c6356 (127.20.244.67:42283), fbd77ca9b1f94911b9bb9bc2162f367e (127.20.244.65:36879)
I20260811 11:46:02.778860 2114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:02.775050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:51743 (local address 127.20.244.67:42283)
0811 11:46:02.775224 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:02.775231 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:02.775447 (+ 216us) server_negotiation.cc:407] Connection header received
0811 11:46:02.775618 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:02.775621 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:02.775671 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:02.775756 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:46:02.776062 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.776613 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.777818 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.778224 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.778356 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:02.778423 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:02.778650 (+ 227us) server_negotiation.cc:299] Negotiation successful
0811 11:46:02.778723 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 11:46:02.778877 2113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:02.775048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:40143 (local address 127.20.244.65:36879)
0811 11:46:02.775259 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:02.775264 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:02.775543 (+ 279us) server_negotiation.cc:407] Connection header received
0811 11:46:02.775691 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:02.775694 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:02.775745 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:02.775829 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:46:02.776124 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.776683 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.777825 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.778236 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.778371 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:02.778429 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:02.778654 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 11:46:02.778735 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260811 11:46:02.778895 2124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:02.774921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:36879 (local address 127.20.244.66:40143)
0811 11:46:02.775448 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0811 11:46:02.775459 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:46:02.775579 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:46:02.775841 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:46:02.775844 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:46:02.775860 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:46:02.775996 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:02.776002 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.776806 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.776812 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:02.777680 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:02.777689 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.778368 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.778372 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:02.778518 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:02.778544 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 11:46:02.778633 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 11:46:02.778735 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"mutex_wait_us":93,"thread_start_us":98,"threads_started":1}
I20260811 11:46:02.778894 2125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:02.774921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:42283 (local address 127.20.244.66:51743)
0811 11:46:02.775341 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0811 11:46:02.775352 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:46:02.775494 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:46:02.775768 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:46:02.775771 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:46:02.775787 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:46:02.775943 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:02.775949 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.776750 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.776754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:02.777679 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:02.777688 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.778354 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.778358 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:02.778462 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:02.778542 (+ 80us) client_negotiation.cc:769] Sending connection context
0811 11:46:02.778632 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 11:46:02.778722 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"mutex_wait_us":142,"thread_start_us":126,"threads_started":1}
I20260811 11:46:02.779800 2038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba7fce8acd0444d0864dfe30024b0460" candidate_uuid: "362f5c53e8a94ec3b85ab99e0f384acf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3479081942d44e4fbf0e73a44d2c6356" is_pre_election: true
I20260811 11:46:02.779815 1690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba7fce8acd0444d0864dfe30024b0460" candidate_uuid: "362f5c53e8a94ec3b85ab99e0f384acf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbd77ca9b1f94911b9bb9bc2162f367e" is_pre_election: true
I20260811 11:46:02.780109 2038 raft_consensus.cc:2454] T ba7fce8acd0444d0864dfe30024b0460 P 3479081942d44e4fbf0e73a44d2c6356 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 362f5c53e8a94ec3b85ab99e0f384acf in term 0.
I20260811 11:46:02.780114 1690 raft_consensus.cc:2454] T ba7fce8acd0444d0864dfe30024b0460 P fbd77ca9b1f94911b9bb9bc2162f367e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 362f5c53e8a94ec3b85ab99e0f384acf in term 0.
I20260811 11:46:02.780579 1776 leader_election.cc:302] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3479081942d44e4fbf0e73a44d2c6356, 362f5c53e8a94ec3b85ab99e0f384acf; no voters:
I20260811 11:46:02.780879 2122 raft_consensus.cc:2781] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:46:02.780969 2122 raft_consensus.cc:482] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:46:02.781034 2122 raft_consensus.cc:3037] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:46:02.782083 2122 raft_consensus.cc:504] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "362f5c53e8a94ec3b85ab99e0f384acf" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44941 } } peers { permanent_uuid: "3479081942d44e4fbf0e73a44d2c6356" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 42283 } } peers { permanent_uuid: "fbd77ca9b1f94911b9bb9bc2162f367e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 36879 } }
I20260811 11:46:02.782454 2122 leader_election.cc:288] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf [CANDIDATE]: Term 1 election: Requested vote from peers 3479081942d44e4fbf0e73a44d2c6356 (127.20.244.67:42283), fbd77ca9b1f94911b9bb9bc2162f367e (127.20.244.65:36879)
I20260811 11:46:02.782820 2038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba7fce8acd0444d0864dfe30024b0460" candidate_uuid: "362f5c53e8a94ec3b85ab99e0f384acf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3479081942d44e4fbf0e73a44d2c6356"
I20260811 11:46:02.782866 1690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba7fce8acd0444d0864dfe30024b0460" candidate_uuid: "362f5c53e8a94ec3b85ab99e0f384acf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbd77ca9b1f94911b9bb9bc2162f367e"
I20260811 11:46:02.782939 2038 raft_consensus.cc:3037] T ba7fce8acd0444d0864dfe30024b0460 P 3479081942d44e4fbf0e73a44d2c6356 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:46:02.783026 1690 raft_consensus.cc:3037] T ba7fce8acd0444d0864dfe30024b0460 P fbd77ca9b1f94911b9bb9bc2162f367e [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:46:02.784085 2038 raft_consensus.cc:2454] T ba7fce8acd0444d0864dfe30024b0460 P 3479081942d44e4fbf0e73a44d2c6356 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 362f5c53e8a94ec3b85ab99e0f384acf in term 1.
I20260811 11:46:02.784197 1690 raft_consensus.cc:2454] T ba7fce8acd0444d0864dfe30024b0460 P fbd77ca9b1f94911b9bb9bc2162f367e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 362f5c53e8a94ec3b85ab99e0f384acf in term 1.
I20260811 11:46:02.784403 1776 leader_election.cc:302] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3479081942d44e4fbf0e73a44d2c6356, 362f5c53e8a94ec3b85ab99e0f384acf; no voters:
I20260811 11:46:02.784564 2122 raft_consensus.cc:2781] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:46:02.784806 2122 raft_consensus.cc:686] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf [term 1 LEADER]: Becoming Leader. State: Replica: 362f5c53e8a94ec3b85ab99e0f384acf, State: Running, Role: LEADER
I20260811 11:46:02.785188 2122 consensus_queue.cc:237] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "362f5c53e8a94ec3b85ab99e0f384acf" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44941 } } peers { permanent_uuid: "3479081942d44e4fbf0e73a44d2c6356" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 42283 } } peers { permanent_uuid: "fbd77ca9b1f94911b9bb9bc2162f367e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 36879 } }
I20260811 11:46:02.788538 1520 catalog_manager.cc:5495] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf reported cstate change: term changed from 0 to 1, leader changed from <none> to 362f5c53e8a94ec3b85ab99e0f384acf (127.20.244.66). New cstate: current_term: 1 leader_uuid: "362f5c53e8a94ec3b85ab99e0f384acf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "362f5c53e8a94ec3b85ab99e0f384acf" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 44941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3479081942d44e4fbf0e73a44d2c6356" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 42283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbd77ca9b1f94911b9bb9bc2162f367e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 36879 } health_report { overall_health: UNKNOWN } } }
I20260811 11:46:02.858964 2111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:02.855248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38132 (local address 127.20.244.66:44941)
0811 11:46:02.855427 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:02.855431 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:02.855446 (+ 15us) server_negotiation.cc:407] Connection header received
0811 11:46:02.855620 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:02.855622 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:02.855682 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:02.855800 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:46:02.856077 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.856608 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.857449 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:02.857670 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:02.857780 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:02.858148 (+ 368us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:46:02.858553 (+ 405us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:46:02.858688 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:02.858754 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 11:46:02.858810 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 11:46:02.864733 1690 raft_consensus.cc:1261] T ba7fce8acd0444d0864dfe30024b0460 P fbd77ca9b1f94911b9bb9bc2162f367e [term 1 FOLLOWER]: Refusing update from remote peer 362f5c53e8a94ec3b85ab99e0f384acf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:46:02.864733 2038 raft_consensus.cc:1261] T ba7fce8acd0444d0864dfe30024b0460 P 3479081942d44e4fbf0e73a44d2c6356 [term 1 FOLLOWER]: Refusing update from remote peer 362f5c53e8a94ec3b85ab99e0f384acf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:46:02.865470 2126 consensus_queue.cc:1035] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbd77ca9b1f94911b9bb9bc2162f367e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 36879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:46:02.865690 2122 consensus_queue.cc:1035] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3479081942d44e4fbf0e73a44d2c6356" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:46:02.872609 2130 mvcc.cc:205] Tried to move back new op lower bound from 7317294132686528512 to 7317294132371107840. Current Snapshot: MvccSnapshot[applied={T|T < 7317294132686528512}]
I20260811 11:46:02.875468 2132 mvcc.cc:205] Tried to move back new op lower bound from 7317294132686528512 to 7317294132371107840. Current Snapshot: MvccSnapshot[applied={T|T < 7317294132686528512}]
I20260811 11:46:02.882033 1517 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:46:02.882176 1517 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:46:02.884711 1517 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 90655aca54c54ddd827b7b63ba61f94c: Sending DeleteTablet for 3 replicas of tablet ba7fce8acd0444d0864dfe30024b0460
I20260811 11:46:02.885450 2009 tablet_service.cc:1514] Processing DeleteTablet for tablet ba7fce8acd0444d0864dfe30024b0460 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:46:02 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:34204
I20260811 11:46:02.885484 1834 tablet_service.cc:1514] Processing DeleteTablet for tablet ba7fce8acd0444d0864dfe30024b0460 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:46:02 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:38124
I20260811 11:46:02.885931 2141 tablet_replica.cc:330] T ba7fce8acd0444d0864dfe30024b0460 P 3479081942d44e4fbf0e73a44d2c6356: stopping tablet replica
I20260811 11:46:02.886226 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 1588
I20260811 11:46:02.886235 2141 raft_consensus.cc:2229] T ba7fce8acd0444d0864dfe30024b0460 P 3479081942d44e4fbf0e73a44d2c6356 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:46:02.886225 1666 tablet_service.cc:1514] Processing DeleteTablet for tablet ba7fce8acd0444d0864dfe30024b0460 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:46:02 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:52166
I20260811 11:46:02.886457 2142 tablet_replica.cc:330] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf: stopping tablet replica
I20260811 11:46:02.886750 2142 raft_consensus.cc:2229] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:46:02.887179 2142 raft_consensus.cc:2258] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:46:02.888068 2141 raft_consensus.cc:2258] T ba7fce8acd0444d0864dfe30024b0460 P 3479081942d44e4fbf0e73a44d2c6356 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:46:02.890436 2141 ts_tablet_manager.cc:1905] T ba7fce8acd0444d0864dfe30024b0460 P 3479081942d44e4fbf0e73a44d2c6356: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:46:02.894496 2141 ts_tablet_manager.cc:1918] T ba7fce8acd0444d0864dfe30024b0460 P 3479081942d44e4fbf0e73a44d2c6356: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:46:02.894634 2141 log.cc:1196] T ba7fce8acd0444d0864dfe30024b0460 P 3479081942d44e4fbf0e73a44d2c6356: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/ba7fce8acd0444d0864dfe30024b0460
I20260811 11:46:02.895112 2141 ts_tablet_manager.cc:1939] T ba7fce8acd0444d0864dfe30024b0460 P 3479081942d44e4fbf0e73a44d2c6356: Deleting consensus metadata
I20260811 11:46:02.897109 1502 catalog_manager.cc:4841] TS 3479081942d44e4fbf0e73a44d2c6356 (127.20.244.67:42283): tablet ba7fce8acd0444d0864dfe30024b0460 (table test-table [id=9596849e79994912b050445019f7963e]) successfully deleted
I20260811 11:46:02.900353 2142 ts_tablet_manager.cc:1905] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:46:02.903143 2142 ts_tablet_manager.cc:1918] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:46:02.903263 2142 log.cc:1196] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/ba7fce8acd0444d0864dfe30024b0460
I20260811 11:46:02.903584 2142 ts_tablet_manager.cc:1939] T ba7fce8acd0444d0864dfe30024b0460 P 362f5c53e8a94ec3b85ab99e0f384acf: Deleting consensus metadata
I20260811 11:46:02.904946 1501 catalog_manager.cc:4841] TS 362f5c53e8a94ec3b85ab99e0f384acf (127.20.244.66:44941): tablet ba7fce8acd0444d0864dfe30024b0460 (table test-table [id=9596849e79994912b050445019f7963e]) successfully deleted
W20260811 11:46:02.906883 1503 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.244.65:36879 (error 108)
I20260811 11:46:02.907043 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 1751
I20260811 11:46:02.910008 2144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:02.909136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:36879 (local address 127.0.0.1:52168)
0811 11:46:02.909779 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0811 11:46:02.909863 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.65:36879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":396,"threads_started":1}
W20260811 11:46:02.910149 1503 catalog_manager.cc:4584] TS fbd77ca9b1f94911b9bb9bc2162f367e (127.20.244.65:36879): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ba7fce8acd0444d0864dfe30024b0460: Network error: Client connection negotiation failed: client connection to 127.20.244.65:36879: connect: Connection refused (error 111)
I20260811 11:46:02.915246 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 1938
I20260811 11:46:02.929798 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 1479
2026-08-11T11:46:02Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2826 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:46:02 dist-test-slave-vkjp krb5kdc[2148](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:46:02 dist-test-slave-vkjp krb5kdc[2148](info): set up 2 sockets
Aug 11 11:46:02 dist-test-slave-vkjp krb5kdc[2148](info): commencing operation
krb5kdc: starting...
W20260811 11:46:04.127259 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:46:04 dist-test-slave-vkjp krb5kdc[2148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448764, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:46:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:46:04Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.20.244.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.20.244.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.20.244.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/rangeradmin_127.20.244.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.20.244.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/rangeradmin_127.20.244.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.20.244.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.20.244.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.20.244.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/rangerlookup_127.20.244.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.20.244.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/rangerlookup_127.20.244.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.244.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.20.244.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.244.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/HTTP_127.20.244.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.244.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/HTTP_127.20.244.84@KRBTEST.COM.keytab.
I20260811 11:46:04.304390 21457 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskVpoijE/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/postgres -l logfile start
2026-08-11 11:46:06.920 UTC [2182] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 11:46:06.920 UTC [2182] LOG: listening on IPv4 address "127.20.244.84", port 35807
2026-08-11 11:46:06.924 UTC [2182] LOG: listening on Unix socket "/tmp/.s.PGSQL.35807"
2026-08-11 11:46:06.961 UTC [2186] LOG: database system was shut down at 2026-08-11 11:46:05 UTC
2026-08-11 11:46:06.966 UTC [2182] LOG: database system is ready to accept connections
I20260811 11:46:08.003790 21457 mini_postgres.cc:96] Postgres bound to 35807
2026-08-11 11:46:08.012 UTC [2201] FATAL: database "slave" does not exist
127.20.244.84:35807 - accepting connections
I20260811 11:46:08.013430 21457 mini_ranger.cc:161] Starting Ranger...
I20260811 11:46:08.030577 21457 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 11:46:08.546579 21457 mini_ranger.cc:87] Created ranger Postgres database
I20260811 11:46:08.546692 21457 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ranger-admin
2026-08-11 11:46:08,953 [I] DB FLAVOR :POSTGRES
2026-08-11 11:46:08,953 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 11:46:08,954 [I] Checking connection..
2026-08-11 11:46:08,954 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 11:46:09,220 [I] Checking connection passed.
2026-08-11 11:46:09,220 [I] --------- Verifying version history table ---------
2026-08-11 11:46:09,220 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 11:46:09,485 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 11:46:09,486 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 11:46:09,756 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 11:46:09,756 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 11:46:09,756 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 11:46:10.004 UTC [2281] WARNING: there is no transaction in progress
2026-08-11 11:46:10,011 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 11:46:10,012 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 11:46:10,259 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 11:46:10,259 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 11:46:10,260 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 11:46:10,532 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 11:46:10,776 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-vkjp.c.gcp-upstream.internal','N') ;"
2026-08-11 11:46:11,016 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 11:46:11,257 [I] Table x_portal_user does not exist in database ranger
2026-08-11 11:46:11,258 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 11:46:11,503 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 11:46:11,503 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 11:46:11,765 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 11:46:12,040 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 11:46:12,041 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 11:46:13.045 UTC [2411] WARNING: there is no transaction in progress
2026-08-11 11:46:13.063 UTC [2411] WARNING: there is no transaction in progress
2026-08-11 11:46:13.080 UTC [2411] WARNING: there is no transaction in progress
2026-08-11 11:46:13.097 UTC [2411] WARNING: there is no transaction in progress
2026-08-11 11:46:13.114 UTC [2411] WARNING: there is no transaction in progress
2026-08-11 11:46:13.132 UTC [2411] WARNING: there is no transaction in progress
2026-08-11 11:46:13.196 UTC [2411] WARNING: there is no transaction in progress
2026-08-11 11:46:13.203 UTC [2411] WARNING: there is no transaction in progress
2026-08-11 11:46:13.218 UTC [2411] WARNING: there is no transaction in progress
2026-08-11 11:46:13.228 UTC [2411] WARNING: there is no transaction in progress
2026-08-11 11:46:13.239 UTC [2411] WARNING: there is no transaction in progress
2026-08-11 11:46:13.253 UTC [2411] WARNING: there is no transaction in progress
2026-08-11 11:46:13.263 UTC [2411] WARNING: there is no transaction in progress
2026-08-11 11:46:13.270 UTC [2411] WARNING: there is no transaction in progress
2026-08-11 11:46:13.278 UTC [2411] WARNING: there is no transaction in progress
2026-08-11 11:46:13.285 UTC [2411] WARNING: there is no transaction in progress
2026-08-11 11:46:13,959 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 11:46:13,960 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 11:46:14,191 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 11:46:14,191 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 11:46:14,460 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 11:46:14,460 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 11:46:14,722 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 11:46:14,722 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 11:46:15,010 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 11:46:15,245 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-vkjp.c.gcp-upstream.internal';"
2026-08-11 11:46:15,480 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 11:46:15,480 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 11:46:15,732 [I] DB_PATCHES have already been applied
I20260811 11:46:15.738581 21457 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ranger-admin:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskVpoijE/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 11:46:15.738651 21457 mini_ranger.cc:193] Using host: 127.20.244.84
I20260811 11:46:15.743136 21457 mini_ranger.cc:227] Ranger admin URL: http://127.20.244.84:33879
Aug 11, 2026 11:46:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 11:46:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 11:46:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 11:46:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 11:46:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 11:46:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 11:46:16 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 11:46:17.061452 21457 mini_ranger.cc:160] Time spent starting Ranger: real 9.048s user 0.000s sys 0.013s
Aug 11, 2026 11:46:38 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 11:46:38 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIs
Aug 11, 2026 11:46:38 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 11:46:38 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 11:46:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 11:46:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 11:46:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 11:46:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 11:46:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 11:46:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 11:46:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 11:46:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 11:46:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 11:46:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 11:46:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 11:46:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 11:46:38 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 11:46:39 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 11:46:39.659744 21457 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.20.244.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.20.244.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.20.244.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/rangerkms_127.20.244.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.20.244.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/rangerkms_127.20.244.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.244.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.20.244.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.244.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/HTTP_127.20.244.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.244.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/HTTP_127.20.244.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 11:46:39 dist-test-slave-vkjp krb5kdc[2148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448799, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 11:46:39.751731 21457 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 11:46:39.762086 21457 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 11:46:40.639230 21457 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 11:46:40.639319 21457 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ranger-kms
I20260811 11:46:40.639422 21457 mini_ranger_kms.cc:227] Using postgres at 127.20.244.84:35807
2026-08-11 11:46:41,282 [I] DB FLAVOR :POSTGRES
2026-08-11 11:46:41,282 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 11:46:41,282 [I] Checking connection
2026-08-11 11:46:41,282 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 11:46:41,534 [I] connection success
2026-08-11 11:46:41,534 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 11:46:41,534 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 11:46:41,534 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 11:46:41,784 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 11:46:41,785 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 11:46:41,785 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 11:46:41,785 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:35807/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 11:46:42,046 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 11:46:42.518579 21457 mini_ranger_kms.cc:310] Created kms service
I20260811 11:46:42.735464 21457 mini_ranger_kms.cc:326] Created kudu user
I20260811 11:46:42.783486 21457 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 11:46:42 dist-test-slave-vkjp krb5kdc[2148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448799, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
I20260811 11:46:43.241377 21457 mini_ranger_kms.cc:384] Added ranger policy
I20260811 11:46:43.241542 21457 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ranger-kms:/tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 11:46:43.241564 21457 mini_ranger_kms.cc:240] Using host: 127.20.244.84
I20260811 11:46:43.246373 21457 mini_ranger_kms.cc:276] Ranger KMS PID: 2632
I20260811 11:46:43.246524 21457 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.20.244.84:55991
Aug 11, 2026 11:46:44 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 11:46:44 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 11:46:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 11:46:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 11:46:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 11:46:44 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260811 11:46:45.704968 21457 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.953s user 0.017s sys 0.300s
I20260811 11:46:45.705127 21457 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 11:46:45.705256 21457 mini_ranger_kms.cc:401] 127.20.244.84:55991/kms/v1/keys
Aug 11 11:46:45 dist-test-slave-vkjp krb5kdc[2148](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786448805, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.244.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 11:46:46 dist-test-slave-vkjp krb5kdc[2148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448805, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.244.84@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
Aug 11 11:46:46 dist-test-slave-vkjp krb5kdc[2148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448805, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.244.84@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
Aug 11 11:46:49 dist-test-slave-vkjp krb5kdc[2148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:46:49.218142 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:40915
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:36073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:40915
--ranger_config_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.244.84:55991/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:46:49.362860 2696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:46:49.363266 2696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:46:49.363356 2696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:46:49.367669 2696 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:46:49.367755 2696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:46:49.367794 2696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:46:49.367846 2696 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:46:49.367882 2696 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:46:49.374015 2696 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:36073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/master-0/wal
--ranger_kms_url=127.20.244.84:55991/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:40915
--ranger_config_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:40915
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:46:49.375254 2696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:46:49.376366 2696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:46:49.386451 2705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:46:49.386586 2707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:46:49.386725 2696 server_base.cc:1034] running on GCE node
W20260811 11:46:49.386458 2704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:46:49.387526 2696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:46:49.388965 2696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:46:49.390172 2696 hybrid_clock.cc:648] HybridClock initialized: now 1786448809390139 us; error 57 us; skew 500 ppm
Aug 11 11:46:49 dist-test-slave-vkjp krb5kdc[2148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448809, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:46:49.398649 2696 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:46:49.399746 2696 webserver.cc:460] Webserver started at http://127.20.244.126:37313/ using document root <none> and password file <none>
I20260811 11:46:49.400336 2696 fs_manager.cc:359] Metadata directory not provided
I20260811 11:46:49.400418 2696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:46:49.400657 2696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 11:46:49 dist-test-slave-vkjp krb5kdc[2148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448809, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
I20260811 11:46:49.463581 2696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "8d3cff31063942259fc1e290b079caf6"
format_stamp: "Formatted at 2026-08-11 11:46:49 on dist-test-slave-vkjp"
server_key: "37fc7b6dd8bafe0801c60ce67170a2b0"
server_key_iv: "84f0ae918715bcb84d134d80390db400"
server_key_version: "kuduclusterkey@0"
I20260811 11:46:49.464331 2696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "8d3cff31063942259fc1e290b079caf6"
format_stamp: "Formatted at 2026-08-11 11:46:49 on dist-test-slave-vkjp"
server_key: "37fc7b6dd8bafe0801c60ce67170a2b0"
server_key_iv: "84f0ae918715bcb84d134d80390db400"
server_key_version: "kuduclusterkey@0"
I20260811 11:46:49.469491 2696 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 11:46:49.486902 2715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:46:49.488651 2696 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 11:46:49.488807 2696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "8d3cff31063942259fc1e290b079caf6"
format_stamp: "Formatted at 2026-08-11 11:46:49 on dist-test-slave-vkjp"
server_key: "37fc7b6dd8bafe0801c60ce67170a2b0"
server_key_iv: "84f0ae918715bcb84d134d80390db400"
server_key_version: "kuduclusterkey@0"
I20260811 11:46:49.488950 2696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:46:49.511121 2696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:46:49.514783 2696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:46:49.515002 2696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:46:49.526927 2696 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:40915
I20260811 11:46:49.527184 2780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:40915 every 8 connection(s)
I20260811 11:46:49.528116 2696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:46:49.532162 2781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:46:49.538193 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 2696
I20260811 11:46:49.538362 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:46:49.538679 21457 external_mini_cluster.cc:1428] Setting key 1dd65147f290d4222bec26cc5b5a889a
I20260811 11:46:49.541145 2781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6: Bootstrap starting.
I20260811 11:46:49.544329 2781 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6: Neither blocks nor log segments found. Creating new log.
I20260811 11:46:49.545387 2781 log.cc:824] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6: Log is configured to *not* fsync() on all Append() calls
I20260811 11:46:49.548031 2781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6: No bootstrap required, opened a new log
Aug 11 11:46:49 dist-test-slave-vkjp krb5kdc[2148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:46:49.552681 2781 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d3cff31063942259fc1e290b079caf6" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40915 } }
I20260811 11:46:49.552994 2781 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:46:49.553097 2781 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d3cff31063942259fc1e290b079caf6, State: Initialized, Role: FOLLOWER
I20260811 11:46:49.553706 2781 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d3cff31063942259fc1e290b079caf6" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40915 } }
I20260811 11:46:49.553990 2781 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:46:49.554070 2781 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:46:49.554188 2781 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:46:49.555119 2786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:49.540335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53118 (local address 127.20.244.126:40915)
0811 11:46:49.540916 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:49.540951 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:49.541000 (+ 49us) server_negotiation.cc:407] Connection header received
0811 11:46:49.541995 (+ 995us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:49.542015 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:49.542355 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:49.542696 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:46:49.543594 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:49.544816 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:49.545766 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:49.546277 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:49.546458 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:49.549375 (+ 2917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:46:49.549382 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:46:49.549396 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:46:49.549425 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:46:49.551847 (+ 2422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:46:49.552312 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:46:49.552326 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:46:49.552331 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:46:49.552441 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:46:49.552737 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:46:49.552741 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:46:49.552743 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:46:49.553286 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:46:49.553517 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:49.553763 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 11:46:49.554304 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":461,"thread_start_us":154,"threads_started":1}
I20260811 11:46:49.555568 2781 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d3cff31063942259fc1e290b079caf6" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40915 } }
I20260811 11:46:49.555932 2781 leader_election.cc:302] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d3cff31063942259fc1e290b079caf6; no voters:
I20260811 11:46:49.556308 2781 leader_election.cc:288] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:46:49.556773 2789 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:46:49.557031 2789 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6 [term 1 LEADER]: Becoming Leader. State: Replica: 8d3cff31063942259fc1e290b079caf6, State: Running, Role: LEADER
I20260811 11:46:49.557667 2781 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:46:49.557665 2789 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d3cff31063942259fc1e290b079caf6" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40915 } }
I20260811 11:46:49.559892 2788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d3cff31063942259fc1e290b079caf6. Latest consensus state: current_term: 1 leader_uuid: "8d3cff31063942259fc1e290b079caf6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d3cff31063942259fc1e290b079caf6" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40915 } } }
I20260811 11:46:49.560055 2788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6 [sys.catalog]: This master's current role is: LEADER
I20260811 11:46:49.560444 2790 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d3cff31063942259fc1e290b079caf6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d3cff31063942259fc1e290b079caf6" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40915 } } }
I20260811 11:46:49.560578 2790 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6 [sys.catalog]: This master's current role is: LEADER
I20260811 11:46:49.562335 2800 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:46:49.562894 2781 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 11:46:49.566035 2800 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:46:49.581848 2800 catalog_manager.cc:1347] Generated new cluster ID: 4a6157df99e840439cc2dbfb34df1be4
I20260811 11:46:49.582000 2800 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:46:49.622283 2800 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:46:49.623746 2800 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:46:49.635942 2800 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6: Generated new TSK 0
I20260811 11:46:49.636986 2800 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.244.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
I20260811 11:46:50.594033 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.244.84:55991/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40915
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:36073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:46:50.777159 2839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:46:50.777534 2839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:46:50.777618 2839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:46:50.783638 2839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:46:50.783793 2839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:46:50.783939 2839 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:46:50.790438 2839 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:36073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.20.244.84:55991/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40915
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:46:50.791594 2839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:46:50.792726 2839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:46:50.805593 2851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:46:50.805817 2850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:46:50.805722 2854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:46:50.806825 2839 server_base.cc:1034] running on GCE node
I20260811 11:46:50.807446 2839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:46:50.808470 2839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:46:50.809713 2839 hybrid_clock.cc:648] HybridClock initialized: now 1786448810809672 us; error 51 us; skew 500 ppm
Aug 11 11:46:50 dist-test-slave-vkjp krb5kdc[2148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448810, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:46:50.814278 2839 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:46:50.815466 2839 webserver.cc:460] Webserver started at http://127.20.244.65:40407/ using document root <none> and password file <none>
I20260811 11:46:50.816197 2839 fs_manager.cc:359] Metadata directory not provided
I20260811 11:46:50.816267 2839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:46:50.816462 2839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 11:46:50 dist-test-slave-vkjp krb5kdc[2148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448810, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
I20260811 11:46:50.835012 2839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "06ccfdc5d2014e30adb47976e6df5129"
format_stamp: "Formatted at 2026-08-11 11:46:50 on dist-test-slave-vkjp"
server_key: "142d8bff19fd2770c57d4e485031f68d"
server_key_iv: "5122082db6164bc55d60784daaa53050"
server_key_version: "kuduclusterkey@0"
I20260811 11:46:50.835791 2839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "06ccfdc5d2014e30adb47976e6df5129"
format_stamp: "Formatted at 2026-08-11 11:46:50 on dist-test-slave-vkjp"
server_key: "142d8bff19fd2770c57d4e485031f68d"
server_key_iv: "5122082db6164bc55d60784daaa53050"
server_key_version: "kuduclusterkey@0"
I20260811 11:46:50.840250 2839 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 11:46:50.858750 2861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:46:50.860590 2839 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260811 11:46:50.860745 2839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "06ccfdc5d2014e30adb47976e6df5129"
format_stamp: "Formatted at 2026-08-11 11:46:50 on dist-test-slave-vkjp"
server_key: "142d8bff19fd2770c57d4e485031f68d"
server_key_iv: "5122082db6164bc55d60784daaa53050"
server_key_version: "kuduclusterkey@0"
I20260811 11:46:50.860904 2839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:46:50.879375 2839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:46:50.883312 2839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:46:50.883574 2839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:46:50.884377 2839 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:46:50.885586 2839 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:46:50.885686 2839 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:46:50.885784 2839 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:46:50.885842 2839 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:46:50.907511 2839 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:33431
I20260811 11:46:50.907663 3001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:33431 every 8 connection(s)
I20260811 11:46:50.909112 2839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:46:50.916961 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 2839
I20260811 11:46:50.917109 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:46:50.917496 21457 external_mini_cluster.cc:1428] Setting key 3e07a1d533d70d5aef5764627a1bdca7
Aug 11 11:46:50 dist-test-slave-vkjp krb5kdc[2148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448810, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:46:50.933200 3004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:50.911746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:42415 (local address 127.20.244.126:40915)
0811 11:46:50.913468 (+ 1722us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:50.913473 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:50.914349 (+ 876us) server_negotiation.cc:407] Connection header received
0811 11:46:50.915713 (+ 1364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:50.915717 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:50.915778 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:50.915858 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:46:50.918653 (+ 2795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:50.919513 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:50.921507 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:50.921813 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:50.921877 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:50.925439 (+ 3562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:46:50.925442 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:46:50.925444 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:46:50.925468 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:46:50.927492 (+ 2024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:46:50.930764 (+ 3272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:46:50.930768 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:46:50.930770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:46:50.930874 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:46:50.931460 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:46:50.931466 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:46:50.931469 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:46:50.931796 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:46:50.931885 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:50.932776 (+ 891us) server_negotiation.cc:299] Negotiation successful
0811 11:46:50.932933 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1601,"thread_start_us":137,"threads_started":1}
WARNING: no policy specified for kudu/127.20.244.66@KRBTEST.COM; defaulting to no policy
I20260811 11:46:50.935323 3006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:50.912346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40915 (local address 127.20.244.65:42415)
0811 11:46:50.913820 (+ 1474us) negotiation.cc:107] Waiting for socket to connect
0811 11:46:50.913880 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 11:46:50.915449 (+ 1569us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:46:50.916297 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:46:50.916306 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:46:50.916757 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:46:50.917548 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:50.917572 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:50.919677 (+ 2105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:50.919683 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:50.921342 (+ 1659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:50.921357 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:50.922050 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:50.922052 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:50.922230 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:50.923021 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:46:50.923038 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:46:50.925231 (+ 2193us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:46:50.930101 (+ 4870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:46:50.930112 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:46:50.930135 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:46:50.930580 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:46:50.931019 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:46:50.931022 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:46:50.931024 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:46:50.931299 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:46:50.931985 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:46:50.931995 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:46:50.932404 (+ 409us) client_negotiation.cc:769] Sending connection context
0811 11:46:50.933786 (+ 1382us) client_negotiation.cc:240] Negotiation successful
0811 11:46:50.934195 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1225,"thread_start_us":261,"threads_started":1}
I20260811 11:46:50.936828 3002 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40915
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.66@KRBTEST.COM" created.
I20260811 11:46:50.937096 3002 heartbeater.cc:464] Registering TS with master...
I20260811 11:46:50.937739 3002 heartbeater.cc:511] Master 127.20.244.126:40915 requested a full tablet report, sending...
I20260811 11:46:50.939677 2737 ts_manager.cc:194] Registered new tserver with Master: 06ccfdc5d2014e30adb47976e6df5129 (127.20.244.65:33431)
I20260811 11:46:50.941285 2737 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:42415
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
I20260811 11:46:50.970628 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.244.84:55991/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40915
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:36073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 11:46:51 dist-test-slave-vkjp krb5kdc[2148](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786448811, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 11:46:51.136132 3012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:46:51.136453 3012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:46:51.136588 3012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:46:51.141198 3012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:46:51.141323 3012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:46:51.141438 3012 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:46:51.148321 3012 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:36073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.20.244.84:55991/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40915
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3012
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:46:51.149534 3012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:46:51.150803 3012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:46:51.162390 3023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:46:51.162457 3019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:46:51.162752 3020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:46:51.163143 3012 server_base.cc:1034] running on GCE node
I20260811 11:46:51.163553 3012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:46:51.164279 3012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:46:51.165463 3012 hybrid_clock.cc:648] HybridClock initialized: now 1786448811165445 us; error 27 us; skew 500 ppm
Aug 11 11:46:51 dist-test-slave-vkjp krb5kdc[2148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448811, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:46:51.169229 3012 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:46:51.170267 3012 webserver.cc:460] Webserver started at http://127.20.244.66:39189/ using document root <none> and password file <none>
I20260811 11:46:51.170964 3012 fs_manager.cc:359] Metadata directory not provided
I20260811 11:46:51.171061 3012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:46:51.171308 3012 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 11:46:51 dist-test-slave-vkjp krb5kdc[2148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448811, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
I20260811 11:46:51.186884 3012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "27c2d988e75b425d98222024c0ad2b8b"
format_stamp: "Formatted at 2026-08-11 11:46:51 on dist-test-slave-vkjp"
server_key: "e083ae97b707a828c795fd14a4e0a1f1"
server_key_iv: "2be3f11452ce745ec79613f3b6639d1b"
server_key_version: "kuduclusterkey@0"
I20260811 11:46:51.187744 3012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "27c2d988e75b425d98222024c0ad2b8b"
format_stamp: "Formatted at 2026-08-11 11:46:51 on dist-test-slave-vkjp"
server_key: "e083ae97b707a828c795fd14a4e0a1f1"
server_key_iv: "2be3f11452ce745ec79613f3b6639d1b"
server_key_version: "kuduclusterkey@0"
I20260811 11:46:51.192544 3012 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260811 11:46:51.211277 3031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:46:51.212884 3012 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 11:46:51.213060 3012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "27c2d988e75b425d98222024c0ad2b8b"
format_stamp: "Formatted at 2026-08-11 11:46:51 on dist-test-slave-vkjp"
server_key: "e083ae97b707a828c795fd14a4e0a1f1"
server_key_iv: "2be3f11452ce745ec79613f3b6639d1b"
server_key_version: "kuduclusterkey@0"
I20260811 11:46:51.213232 3012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:46:51.230604 3012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:46:51.235693 3012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:46:51.235982 3012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:46:51.236968 3012 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:46:51.238461 3012 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:46:51.238607 3012 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 11:46:51.238739 3012 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:46:51.238821 3012 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:46:51.258250 3012 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:34387
I20260811 11:46:51.259919 3012 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:46:51.260329 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 3012
I20260811 11:46:51.260485 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:46:51.260959 21457 external_mini_cluster.cc:1428] Setting key caa984bd9d2d8202edbfd73e8eca8bdb
I20260811 11:46:51.275599 3166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:34387 every 8 connection(s)
Aug 11 11:46:51 dist-test-slave-vkjp krb5kdc[2148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448811, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.244.67@KRBTEST.COM; defaulting to no policy
I20260811 11:46:51.304250 3004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:51.280859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:33313 (local address 127.20.244.126:40915)
0811 11:46:51.281032 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:51.281038 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:51.283572 (+ 2534us) server_negotiation.cc:407] Connection header received
0811 11:46:51.285103 (+ 1531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:51.285108 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:51.285177 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:51.285243 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:46:51.287460 (+ 2217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:51.288434 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:51.290560 (+ 2126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:51.291002 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:51.291134 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:51.298914 (+ 7780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:46:51.298932 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:46:51.298937 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:46:51.298973 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:46:51.301391 (+ 2418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:46:51.302216 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:46:51.302222 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:46:51.302225 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:46:51.302340 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:46:51.302785 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:46:51.302788 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:46:51.302790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:46:51.303130 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:46:51.303250 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:51.303872 (+ 622us) server_negotiation.cc:299] Negotiation successful
0811 11:46:51.304014 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.67@KRBTEST.COM" created.
I20260811 11:46:51.305476 3170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:51.279535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40915 (local address 127.20.244.66:33313)
0811 11:46:51.283360 (+ 3825us) negotiation.cc:107] Waiting for socket to connect
0811 11:46:51.283432 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0811 11:46:51.284790 (+ 1358us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:46:51.285720 (+ 930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:46:51.285730 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:46:51.286247 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:46:51.287224 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:51.287252 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:51.288655 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:51.288659 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:51.290371 (+ 1712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:51.290386 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:51.291395 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:51.291400 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:51.291649 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:51.294169 (+ 2520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:46:51.294198 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:46:51.298619 (+ 4421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:46:51.301598 (+ 2979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:46:51.301607 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:46:51.301630 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:46:51.302070 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:46:51.302469 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:46:51.302474 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:46:51.302479 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:46:51.302663 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:46:51.303250 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:46:51.303259 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:46:51.303597 (+ 338us) client_negotiation.cc:769] Sending connection context
0811 11:46:51.303807 (+ 210us) client_negotiation.cc:240] Negotiation successful
0811 11:46:51.304164 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3549,"thread_start_us":213,"threads_started":1}
I20260811 11:46:51.306983 3167 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40915
I20260811 11:46:51.307286 3167 heartbeater.cc:464] Registering TS with master...
I20260811 11:46:51.307932 3167 heartbeater.cc:511] Master 127.20.244.126:40915 requested a full tablet report, sending...
I20260811 11:46:51.309120 2737 ts_manager.cc:194] Registered new tserver with Master: 27c2d988e75b425d98222024c0ad2b8b (127.20.244.66:34387)
I20260811 11:46:51.309914 2737 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:33313
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
I20260811 11:46:51.336103 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.244.84:55991/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40915
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:36073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:46:51.578547 3172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:46:51.578962 3172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:46:51.579110 3172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:46:51.586375 3172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:46:51.586530 3172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:46:51.586668 3172 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:46:51.594854 3172 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:36073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.20.244.84:55991/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40915
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:46:51.596534 3172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:46:51.597963 3172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:46:51.614913 3180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:46:51.614913 3182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:46:51.615528 3177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:46:51.616876 3172 server_base.cc:1034] running on GCE node
I20260811 11:46:51.617421 3172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:46:51.618248 3172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:46:51.619467 3172 hybrid_clock.cc:648] HybridClock initialized: now 1786448811619397 us; error 87 us; skew 500 ppm
Aug 11 11:46:51 dist-test-slave-vkjp krb5kdc[2148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448811, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:46:51.623806 3172 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:46:51.625259 3172 webserver.cc:460] Webserver started at http://127.20.244.67:39269/ using document root <none> and password file <none>
I20260811 11:46:51.626044 3172 fs_manager.cc:359] Metadata directory not provided
I20260811 11:46:51.626179 3172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:46:51.626552 3172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 11:46:51 dist-test-slave-vkjp krb5kdc[2148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448811, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
I20260811 11:46:51.650951 3172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "4cf9d13ef9394f2ca910c3da06066ff3"
format_stamp: "Formatted at 2026-08-11 11:46:51 on dist-test-slave-vkjp"
server_key: "b1df9b6d0894855ee7c04e93cba9ff3f"
server_key_iv: "511d01b96e0d3d2f2a5b6b6ce6d35bf2"
server_key_version: "kuduclusterkey@0"
I20260811 11:46:51.651798 3172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "4cf9d13ef9394f2ca910c3da06066ff3"
format_stamp: "Formatted at 2026-08-11 11:46:51 on dist-test-slave-vkjp"
server_key: "b1df9b6d0894855ee7c04e93cba9ff3f"
server_key_iv: "511d01b96e0d3d2f2a5b6b6ce6d35bf2"
server_key_version: "kuduclusterkey@0"
I20260811 11:46:51.657709 3172 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 11:46:51.680549 3191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:46:51.682299 3172 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.002s
I20260811 11:46:51.682436 3172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "4cf9d13ef9394f2ca910c3da06066ff3"
format_stamp: "Formatted at 2026-08-11 11:46:51 on dist-test-slave-vkjp"
server_key: "b1df9b6d0894855ee7c04e93cba9ff3f"
server_key_iv: "511d01b96e0d3d2f2a5b6b6ce6d35bf2"
server_key_version: "kuduclusterkey@0"
I20260811 11:46:51.682564 3172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:46:51.733471 3172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:46:51.743281 3172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:46:51.743564 3172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:46:51.744305 3172 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:46:51.745483 3172 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:46:51.745604 3172 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:46:51.745715 3172 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:46:51.745780 3172 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 11:46:51 dist-test-slave-vkjp krb5kdc[2148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448811, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
I20260811 11:46:51.798552 3172 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:36297
I20260811 11:46:51.799747 3335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:36297 every 8 connection(s)
I20260811 11:46:51.800551 3172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:46:51.809855 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 3172
I20260811 11:46:51.810009 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:46:51.810364 21457 external_mini_cluster.cc:1428] Setting key 9bf5b14722beaf74cdea64b9e183d515
Aug 11 11:46:51 dist-test-slave-vkjp krb5kdc[2148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448811, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:46:51.843708 3340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:51.816263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:38141 (local address 127.20.244.126:40915)
0811 11:46:51.827315 (+ 11052us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:51.827321 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:51.827346 (+ 25us) server_negotiation.cc:407] Connection header received
0811 11:46:51.828190 (+ 844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:51.828194 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:51.828263 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:51.828350 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:46:51.830336 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:51.831182 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:51.832964 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:51.833319 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:51.833409 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:51.838960 (+ 5551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:46:51.838965 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:46:51.838968 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:46:51.838998 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:46:51.841021 (+ 2023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:46:51.841713 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:46:51.841718 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:46:51.841720 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:46:51.841817 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:46:51.842249 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:46:51.842253 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:46:51.842255 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:46:51.842486 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:46:51.842562 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:51.843371 (+ 809us) server_negotiation.cc:299] Negotiation successful
0811 11:46:51.843515 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10920,"thread_start_us":117,"threads_started":1}
I20260811 11:46:51.845809 3339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:51.814988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40915 (local address 127.20.244.67:38141)
0811 11:46:51.825816 (+ 10828us) negotiation.cc:107] Waiting for socket to connect
0811 11:46:51.825895 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0811 11:46:51.827802 (+ 1907us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:46:51.828679 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:46:51.828691 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:46:51.829301 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:46:51.830110 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:51.830133 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:51.831351 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:51.831355 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:51.832806 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:51.832819 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:51.833647 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:51.833651 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:51.833946 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:51.834861 (+ 915us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:46:51.834888 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:46:51.838753 (+ 3865us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:46:51.841185 (+ 2432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:46:51.841192 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:46:51.841210 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:46:51.841587 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:46:51.841935 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:46:51.841939 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:46:51.841941 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:46:51.842122 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:46:51.842653 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:46:51.842660 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:46:51.843021 (+ 361us) client_negotiation.cc:769] Sending connection context
0811 11:46:51.844251 (+ 1230us) client_negotiation.cc:240] Negotiation successful
0811 11:46:51.844627 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2241,"thread_start_us":221,"threads_started":1}
I20260811 11:46:51.847426 3336 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40915
I20260811 11:46:51.847687 3336 heartbeater.cc:464] Registering TS with master...
I20260811 11:46:51.848230 3336 heartbeater.cc:511] Master 127.20.244.126:40915 requested a full tablet report, sending...
I20260811 11:46:51.849377 2737 ts_manager.cc:194] Registered new tserver with Master: 4cf9d13ef9394f2ca910c3da06066ff3 (127.20.244.67:36297)
I20260811 11:46:51.850142 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:46:51.850173 2737 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:38141
I20260811 11:46:51.869421 3340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:51.855598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51220 (local address 127.20.244.126:40915)
0811 11:46:51.855724 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:51.855728 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:51.858910 (+ 3182us) server_negotiation.cc:407] Connection header received
0811 11:46:51.859151 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:51.859155 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:51.859212 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:51.859272 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:46:51.860409 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:51.861267 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:51.862671 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:51.863063 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:51.863186 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:51.865272 (+ 2086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:46:51.865276 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:46:51.865279 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:46:51.865307 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:46:51.867313 (+ 2006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:46:51.867861 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:46:51.867865 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:46:51.867866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:46:51.867976 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:46:51.868280 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:46:51.868283 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:46:51.868284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:46:51.868511 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:46:51.868614 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:51.869102 (+ 488us) server_negotiation.cc:299] Negotiation successful
0811 11:46:51.869252 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 11:46:51.873775 2737 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51220:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:46:51.877311 2737 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:46:51.895572 3354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:51.888336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:33431 (local address 127.0.0.1:58254)
0811 11:46:51.889241 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0811 11:46:51.889257 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:46:51.889378 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:46:51.891109 (+ 1731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:46:51.891112 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:46:51.891130 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:46:51.891308 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:51.891316 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:51.892745 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:51.892749 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:51.893862 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:51.893872 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:51.895015 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:51.895019 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:51.895157 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:51.895199 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 11:46:51.895297 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 11:46:51.895405 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":835,"mutex_wait_us":16,"thread_start_us":169,"threads_started":1}
I20260811 11:46:51.895622 3355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:51.888659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58254 (local address 127.20.244.65:33431)
0811 11:46:51.890617 (+ 1958us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:51.890624 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:51.890672 (+ 48us) server_negotiation.cc:407] Connection header received
0811 11:46:51.890749 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:51.890754 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:51.890933 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:51.891464 (+ 531us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:46:51.891591 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:51.892611 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:51.894007 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:51.894866 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:51.895165 (+ 299us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:51.895315 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:51.895366 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 11:46:51.895466 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1802,"thread_start_us":157,"threads_started":1}
I20260811 11:46:51.895813 3350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:51.887201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44460 (local address 127.20.244.66:34387)
0811 11:46:51.887620 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:51.887628 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:51.888277 (+ 649us) server_negotiation.cc:407] Connection header received
0811 11:46:51.888587 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:51.888594 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:51.888833 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:51.888963 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:46:51.890736 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:51.891914 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:51.894154 (+ 2240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:51.894914 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:51.894997 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:51.895203 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:51.895549 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 11:46:51.895659 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":150,"threads_started":1}
I20260811 11:46:51.896304 3351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:51.887150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39752 (local address 127.20.244.67:36297)
0811 11:46:51.887849 (+ 699us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:51.887862 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:51.889014 (+ 1152us) server_negotiation.cc:407] Connection header received
0811 11:46:51.889232 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:51.889238 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:51.889429 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:51.889606 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:46:51.890230 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:51.891665 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:51.893602 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:51.894560 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:51.894639 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:51.894774 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:51.896023 (+ 1249us) server_negotiation.cc:299] Negotiation successful
0811 11:46:51.896132 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":339,"threads_started":1}
I20260811 11:46:51.896731 3352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:51.886833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:36297 (local address 127.0.0.1:39752)
0811 11:46:51.888350 (+ 1517us) negotiation.cc:107] Waiting for socket to connect
0811 11:46:51.888364 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:46:51.889089 (+ 725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:46:51.889790 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:46:51.889793 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:46:51.889822 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:46:51.890066 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:51.890075 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:51.891835 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:51.891838 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:51.893323 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:51.893334 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:51.894931 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:51.894934 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:51.895839 (+ 905us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:51.895874 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 11:46:51.896503 (+ 629us) client_negotiation.cc:240] Negotiation successful
0811 11:46:51.896564 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1447,"mutex_wait_us":64,"spinlock_wait_cycles":48256,"thread_start_us":953,"threads_started":1}
I20260811 11:46:51.896731 3353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:51.886796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:34387 (local address 127.0.0.1:44460)
0811 11:46:51.888140 (+ 1344us) negotiation.cc:107] Waiting for socket to connect
0811 11:46:51.888192 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 11:46:51.888388 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:46:51.889714 (+ 1326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:46:51.889723 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:46:51.889756 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:46:51.890187 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:51.890200 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:51.892045 (+ 1845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:51.892049 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:51.894035 (+ 1986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:51.894043 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:51.895301 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:51.895304 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:51.895398 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:51.895420 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 11:46:51.896316 (+ 896us) client_negotiation.cc:240] Negotiation successful
0811 11:46:51.896564 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1183,"spinlock_wait_cycles":11264,"thread_start_us":862,"threads_started":1}
I20260811 11:46:51.899461 3245 tablet_service.cc:1467] Processing CreateTablet for tablet bcefabf94c304421a1fee661d3d3f5ac (DEFAULT_TABLE table=test-table [id=977daaecf02d47249d2d37db2db13e5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:46:51.899480 2918 tablet_service.cc:1467] Processing CreateTablet for tablet bcefabf94c304421a1fee661d3d3f5ac (DEFAULT_TABLE table=test-table [id=977daaecf02d47249d2d37db2db13e5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:46:51.900569 3245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcefabf94c304421a1fee661d3d3f5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:46:51.900622 2918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcefabf94c304421a1fee661d3d3f5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:46:51.900795 3088 tablet_service.cc:1467] Processing CreateTablet for tablet bcefabf94c304421a1fee661d3d3f5ac (DEFAULT_TABLE table=test-table [id=977daaecf02d47249d2d37db2db13e5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:46:51.901801 3088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcefabf94c304421a1fee661d3d3f5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:46:51.911768 3356 tablet_bootstrap.cc:492] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3: Bootstrap starting.
I20260811 11:46:51.914772 3356 tablet_bootstrap.cc:654] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3: Neither blocks nor log segments found. Creating new log.
I20260811 11:46:51.916098 3356 log.cc:824] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3: Log is configured to *not* fsync() on all Append() calls
I20260811 11:46:51.916725 3357 tablet_bootstrap.cc:492] T bcefabf94c304421a1fee661d3d3f5ac P 27c2d988e75b425d98222024c0ad2b8b: Bootstrap starting.
I20260811 11:46:51.919206 3356 tablet_bootstrap.cc:492] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3: No bootstrap required, opened a new log
I20260811 11:46:51.919358 3357 tablet_bootstrap.cc:654] T bcefabf94c304421a1fee661d3d3f5ac P 27c2d988e75b425d98222024c0ad2b8b: Neither blocks nor log segments found. Creating new log.
I20260811 11:46:51.919548 3356 ts_tablet_manager.cc:1397] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.005s
I20260811 11:46:51.920500 3357 log.cc:824] T bcefabf94c304421a1fee661d3d3f5ac P 27c2d988e75b425d98222024c0ad2b8b: Log is configured to *not* fsync() on all Append() calls
I20260811 11:46:51.921298 3358 tablet_bootstrap.cc:492] T bcefabf94c304421a1fee661d3d3f5ac P 06ccfdc5d2014e30adb47976e6df5129: Bootstrap starting.
I20260811 11:46:51.923226 3358 tablet_bootstrap.cc:654] T bcefabf94c304421a1fee661d3d3f5ac P 06ccfdc5d2014e30adb47976e6df5129: Neither blocks nor log segments found. Creating new log.
I20260811 11:46:51.924301 3358 log.cc:824] T bcefabf94c304421a1fee661d3d3f5ac P 06ccfdc5d2014e30adb47976e6df5129: Log is configured to *not* fsync() on all Append() calls
I20260811 11:46:51.925463 3356 raft_consensus.cc:348] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c2d988e75b425d98222024c0ad2b8b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 34387 } } peers { permanent_uuid: "4cf9d13ef9394f2ca910c3da06066ff3" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 36297 } } peers { permanent_uuid: "06ccfdc5d2014e30adb47976e6df5129" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 33431 } }
I20260811 11:46:51.925733 3356 raft_consensus.cc:374] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:46:51.925791 3356 raft_consensus.cc:729] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf9d13ef9394f2ca910c3da06066ff3, State: Initialized, Role: FOLLOWER
I20260811 11:46:51.925894 3357 tablet_bootstrap.cc:492] T bcefabf94c304421a1fee661d3d3f5ac P 27c2d988e75b425d98222024c0ad2b8b: No bootstrap required, opened a new log
I20260811 11:46:51.926085 3357 ts_tablet_manager.cc:1397] T bcefabf94c304421a1fee661d3d3f5ac P 27c2d988e75b425d98222024c0ad2b8b: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260811 11:46:51.926283 3356 consensus_queue.cc:260] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c2d988e75b425d98222024c0ad2b8b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 34387 } } peers { permanent_uuid: "4cf9d13ef9394f2ca910c3da06066ff3" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 36297 } } peers { permanent_uuid: "06ccfdc5d2014e30adb47976e6df5129" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 33431 } }
I20260811 11:46:51.927757 3356 ts_tablet_manager.cc:1428] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260811 11:46:51.928011 3336 heartbeater.cc:503] Master 127.20.244.126:40915 was elected leader, sending a full tablet report...
I20260811 11:46:51.933710 3358 tablet_bootstrap.cc:492] T bcefabf94c304421a1fee661d3d3f5ac P 06ccfdc5d2014e30adb47976e6df5129: No bootstrap required, opened a new log
I20260811 11:46:51.934028 3358 ts_tablet_manager.cc:1397] T bcefabf94c304421a1fee661d3d3f5ac P 06ccfdc5d2014e30adb47976e6df5129: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.005s
I20260811 11:46:51.933827 3357 raft_consensus.cc:348] T bcefabf94c304421a1fee661d3d3f5ac P 27c2d988e75b425d98222024c0ad2b8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c2d988e75b425d98222024c0ad2b8b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 34387 } } peers { permanent_uuid: "4cf9d13ef9394f2ca910c3da06066ff3" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 36297 } } peers { permanent_uuid: "06ccfdc5d2014e30adb47976e6df5129" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 33431 } }
I20260811 11:46:51.934100 3357 raft_consensus.cc:374] T bcefabf94c304421a1fee661d3d3f5ac P 27c2d988e75b425d98222024c0ad2b8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:46:51.934171 3357 raft_consensus.cc:729] T bcefabf94c304421a1fee661d3d3f5ac P 27c2d988e75b425d98222024c0ad2b8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27c2d988e75b425d98222024c0ad2b8b, State: Initialized, Role: FOLLOWER
I20260811 11:46:51.934719 3357 consensus_queue.cc:260] T bcefabf94c304421a1fee661d3d3f5ac P 27c2d988e75b425d98222024c0ad2b8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c2d988e75b425d98222024c0ad2b8b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 34387 } } peers { permanent_uuid: "4cf9d13ef9394f2ca910c3da06066ff3" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 36297 } } peers { permanent_uuid: "06ccfdc5d2014e30adb47976e6df5129" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 33431 } }
I20260811 11:46:51.935976 3357 ts_tablet_manager.cc:1428] T bcefabf94c304421a1fee661d3d3f5ac P 27c2d988e75b425d98222024c0ad2b8b: Time spent starting tablet: real 0.010s user 0.007s sys 0.001s
I20260811 11:46:51.936329 3167 heartbeater.cc:503] Master 127.20.244.126:40915 was elected leader, sending a full tablet report...
I20260811 11:46:51.939599 3358 raft_consensus.cc:348] T bcefabf94c304421a1fee661d3d3f5ac P 06ccfdc5d2014e30adb47976e6df5129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c2d988e75b425d98222024c0ad2b8b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 34387 } } peers { permanent_uuid: "4cf9d13ef9394f2ca910c3da06066ff3" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 36297 } } peers { permanent_uuid: "06ccfdc5d2014e30adb47976e6df5129" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 33431 } }
I20260811 11:46:51.939956 3358 raft_consensus.cc:374] T bcefabf94c304421a1fee661d3d3f5ac P 06ccfdc5d2014e30adb47976e6df5129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:46:51.940049 3358 raft_consensus.cc:729] T bcefabf94c304421a1fee661d3d3f5ac P 06ccfdc5d2014e30adb47976e6df5129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ccfdc5d2014e30adb47976e6df5129, State: Initialized, Role: FOLLOWER
I20260811 11:46:51.940547 3358 consensus_queue.cc:260] T bcefabf94c304421a1fee661d3d3f5ac P 06ccfdc5d2014e30adb47976e6df5129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c2d988e75b425d98222024c0ad2b8b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 34387 } } peers { permanent_uuid: "4cf9d13ef9394f2ca910c3da06066ff3" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 36297 } } peers { permanent_uuid: "06ccfdc5d2014e30adb47976e6df5129" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 33431 } }
I20260811 11:46:51.941871 3002 heartbeater.cc:503] Master 127.20.244.126:40915 was elected leader, sending a full tablet report...
I20260811 11:46:51.942057 3358 ts_tablet_manager.cc:1428] T bcefabf94c304421a1fee661d3d3f5ac P 06ccfdc5d2014e30adb47976e6df5129: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
W20260811 11:46:52.027695 3168 tablet.cc:2369] T bcefabf94c304421a1fee661d3d3f5ac P 27c2d988e75b425d98222024c0ad2b8b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:46:52.061283 3337 tablet.cc:2369] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 11:46:52 dist-test-slave-vkjp krb5kdc[2148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448811, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
I20260811 11:46:52.123179 3362 raft_consensus.cc:482] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:46:52.123449 3362 raft_consensus.cc:504] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c2d988e75b425d98222024c0ad2b8b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 34387 } } peers { permanent_uuid: "4cf9d13ef9394f2ca910c3da06066ff3" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 36297 } } peers { permanent_uuid: "06ccfdc5d2014e30adb47976e6df5129" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 33431 } }
I20260811 11:46:52.124903 3362 leader_election.cc:288] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27c2d988e75b425d98222024c0ad2b8b (127.20.244.66:34387), 06ccfdc5d2014e30adb47976e6df5129 (127.20.244.65:33431)
I20260811 11:46:52.130043 3339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:52.125199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:33431 (local address 127.20.244.67:34275)
0811 11:46:52.125419 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 11:46:52.125435 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:46:52.125570 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:46:52.125937 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:46:52.125941 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:46:52.125964 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:46:52.126093 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:52.126100 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:52.127151 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:52.127158 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:52.128402 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:52.128415 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:52.129462 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:52.129466 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:52.129700 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:52.129727 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 11:46:52.129805 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 11:46:52.129893 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":33}
I20260811 11:46:52.130573 3355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:52.125576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:34275 (local address 127.20.244.65:33431)
0811 11:46:52.125704 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:52.125709 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:52.125725 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:46:52.125780 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:52.125784 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:52.125832 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:52.125920 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:46:52.126246 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:52.126976 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:52.128605 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:52.129201 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:52.129325 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:52.129384 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:52.130343 (+ 959us) server_negotiation.cc:299] Negotiation successful
0811 11:46:52.130434 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 11:46:52.131438 2944 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcefabf94c304421a1fee661d3d3f5ac" candidate_uuid: "4cf9d13ef9394f2ca910c3da06066ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ccfdc5d2014e30adb47976e6df5129" is_pre_election: true
I20260811 11:46:52.131829 2944 raft_consensus.cc:2454] T bcefabf94c304421a1fee661d3d3f5ac P 06ccfdc5d2014e30adb47976e6df5129 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf9d13ef9394f2ca910c3da06066ff3 in term 0.
I20260811 11:46:52.132050 3350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:52.125537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:42455 (local address 127.20.244.66:34387)
0811 11:46:52.125689 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:52.125693 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:52.126647 (+ 954us) server_negotiation.cc:407] Connection header received
0811 11:46:52.126821 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:52.126825 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:52.126873 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:52.126919 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:46:52.127434 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:52.128205 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:52.130013 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:52.130711 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:52.130807 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:52.130852 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:52.131838 (+ 986us) server_negotiation.cc:299] Negotiation successful
0811 11:46:52.131915 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 11:46:52.132648 3366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:52.125302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:34387 (local address 127.20.244.67:42455)
0811 11:46:52.126558 (+ 1256us) negotiation.cc:107] Waiting for socket to connect
0811 11:46:52.126573 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:46:52.126710 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:46:52.127068 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:46:52.127071 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:46:52.127118 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:46:52.127287 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:52.127296 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:52.128359 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:52.128362 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:52.129850 (+ 1488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:46:52.129862 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:46:52.131481 (+ 1619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:46:52.131486 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:46:52.131678 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:52.131710 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 11:46:52.132354 (+ 644us) client_negotiation.cc:240] Negotiation successful
0811 11:46:52.132434 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1188,"mutex_wait_us":28,"thread_start_us":179,"threads_started":1}
I20260811 11:46:52.132614 3193 leader_election.cc:302] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ccfdc5d2014e30adb47976e6df5129, 4cf9d13ef9394f2ca910c3da06066ff3; no voters:
I20260811 11:46:52.132984 3362 raft_consensus.cc:2781] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:46:52.133088 3362 raft_consensus.cc:482] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:46:52.133204 3362 raft_consensus.cc:3037] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:46:52.133466 3113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcefabf94c304421a1fee661d3d3f5ac" candidate_uuid: "4cf9d13ef9394f2ca910c3da06066ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c2d988e75b425d98222024c0ad2b8b" is_pre_election: true
I20260811 11:46:52.133754 3113 raft_consensus.cc:2454] T bcefabf94c304421a1fee661d3d3f5ac P 27c2d988e75b425d98222024c0ad2b8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf9d13ef9394f2ca910c3da06066ff3 in term 0.
I20260811 11:46:52.134865 3362 raft_consensus.cc:504] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c2d988e75b425d98222024c0ad2b8b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 34387 } } peers { permanent_uuid: "4cf9d13ef9394f2ca910c3da06066ff3" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 36297 } } peers { permanent_uuid: "06ccfdc5d2014e30adb47976e6df5129" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 33431 } }
I20260811 11:46:52.135334 3362 leader_election.cc:288] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3 [CANDIDATE]: Term 1 election: Requested vote from peers 27c2d988e75b425d98222024c0ad2b8b (127.20.244.66:34387), 06ccfdc5d2014e30adb47976e6df5129 (127.20.244.65:33431)
I20260811 11:46:52.135661 3113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcefabf94c304421a1fee661d3d3f5ac" candidate_uuid: "4cf9d13ef9394f2ca910c3da06066ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c2d988e75b425d98222024c0ad2b8b"
I20260811 11:46:52.135787 3113 raft_consensus.cc:3037] T bcefabf94c304421a1fee661d3d3f5ac P 27c2d988e75b425d98222024c0ad2b8b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:46:52.135797 2944 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcefabf94c304421a1fee661d3d3f5ac" candidate_uuid: "4cf9d13ef9394f2ca910c3da06066ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ccfdc5d2014e30adb47976e6df5129"
I20260811 11:46:52.135908 2944 raft_consensus.cc:3037] T bcefabf94c304421a1fee661d3d3f5ac P 06ccfdc5d2014e30adb47976e6df5129 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:46:52.137462 3113 raft_consensus.cc:2454] T bcefabf94c304421a1fee661d3d3f5ac P 27c2d988e75b425d98222024c0ad2b8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf9d13ef9394f2ca910c3da06066ff3 in term 1.
I20260811 11:46:52.137569 2944 raft_consensus.cc:2454] T bcefabf94c304421a1fee661d3d3f5ac P 06ccfdc5d2014e30adb47976e6df5129 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf9d13ef9394f2ca910c3da06066ff3 in term 1.
I20260811 11:46:52.137887 3193 leader_election.cc:302] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ccfdc5d2014e30adb47976e6df5129, 4cf9d13ef9394f2ca910c3da06066ff3; no voters:
I20260811 11:46:52.138123 3362 raft_consensus.cc:2781] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:46:52.138407 3362 raft_consensus.cc:686] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf9d13ef9394f2ca910c3da06066ff3, State: Running, Role: LEADER
I20260811 11:46:52.138772 3362 consensus_queue.cc:237] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c2d988e75b425d98222024c0ad2b8b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 34387 } } peers { permanent_uuid: "4cf9d13ef9394f2ca910c3da06066ff3" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 36297 } } peers { permanent_uuid: "06ccfdc5d2014e30adb47976e6df5129" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 33431 } }
I20260811 11:46:52.142431 2737 catalog_manager.cc:5495] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf9d13ef9394f2ca910c3da06066ff3 (127.20.244.67). New cstate: current_term: 1 leader_uuid: "4cf9d13ef9394f2ca910c3da06066ff3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c2d988e75b425d98222024c0ad2b8b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 34387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf9d13ef9394f2ca910c3da06066ff3" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06ccfdc5d2014e30adb47976e6df5129" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 33431 } health_report { overall_health: UNKNOWN } } }
W20260811 11:46:52.164428 3003 tablet.cc:2369] T bcefabf94c304421a1fee661d3d3f5ac P 06ccfdc5d2014e30adb47976e6df5129: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:46:52.199246 3351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:52.193359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39768 (local address 127.20.244.67:36297)
0811 11:46:52.193500 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 11:46:52.193505 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:46:52.193521 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:46:52.193733 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:46:52.193736 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:46:52.193821 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:46:52.193954 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:46:52.194371 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:52.195314 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:52.196771 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:46:52.197173 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:46:52.197281 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:46:52.197754 (+ 473us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:46:52.198371 (+ 617us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:46:52.198501 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 11:46:52.198985 (+ 484us) server_negotiation.cc:299] Negotiation successful
0811 11:46:52.199053 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 11:46:52.207929 2944 raft_consensus.cc:1261] T bcefabf94c304421a1fee661d3d3f5ac P 06ccfdc5d2014e30adb47976e6df5129 [term 1 FOLLOWER]: Refusing update from remote peer 4cf9d13ef9394f2ca910c3da06066ff3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:46:52.208874 3362 consensus_queue.cc:1035] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ccfdc5d2014e30adb47976e6df5129" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 33431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:46:52.216651 3113 raft_consensus.cc:1261] T bcefabf94c304421a1fee661d3d3f5ac P 27c2d988e75b425d98222024c0ad2b8b [term 1 FOLLOWER]: Refusing update from remote peer 4cf9d13ef9394f2ca910c3da06066ff3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:46:52.217516 3362 consensus_queue.cc:1035] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27c2d988e75b425d98222024c0ad2b8b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 34387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:46:52.229562 3373 mvcc.cc:205] Tried to move back new op lower bound from 7317294334793146368 to 7317294334523285504. Current Snapshot: MvccSnapshot[applied={T|T < 7317294334793146368}]
I20260811 11:46:52.243710 2737 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:46:52.243959 2737 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:46:52.244194 3377 mvcc.cc:205] Tried to move back new op lower bound from 7317294334793146368 to 7317294334523285504. Current Snapshot: MvccSnapshot[applied={T|T < 7317294334793146368 or (T in {7317294334793146368})}]
I20260811 11:46:52.246147 3374 mvcc.cc:205] Tried to move back new op lower bound from 7317294334793146368 to 7317294334523285504. Current Snapshot: MvccSnapshot[applied={T|T < 7317294334793146368}]
I20260811 11:46:52.247117 2737 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8d3cff31063942259fc1e290b079caf6: Sending DeleteTablet for 3 replicas of tablet bcefabf94c304421a1fee661d3d3f5ac
I20260811 11:46:52.248266 3088 tablet_service.cc:1514] Processing DeleteTablet for tablet bcefabf94c304421a1fee661d3d3f5ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:46:52 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:44460
I20260811 11:46:52.249526 3245 tablet_service.cc:1514] Processing DeleteTablet for tablet bcefabf94c304421a1fee661d3d3f5ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:46:52 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:39752
I20260811 11:46:52.250195 2918 tablet_service.cc:1514] Processing DeleteTablet for tablet bcefabf94c304421a1fee661d3d3f5ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:46:52 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:58254
I20260811 11:46:52.250720 3387 tablet_replica.cc:330] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3: stopping tablet replica
I20260811 11:46:52.251104 3387 raft_consensus.cc:2229] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:46:52.251564 3387 raft_consensus.cc:2258] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:46:52.251585 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 2839
I20260811 11:46:52.257377 3387 ts_tablet_manager.cc:1905] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:46:52.257745 3386 tablet_replica.cc:330] T bcefabf94c304421a1fee661d3d3f5ac P 27c2d988e75b425d98222024c0ad2b8b: stopping tablet replica
I20260811 11:46:52.258118 3386 raft_consensus.cc:2229] T bcefabf94c304421a1fee661d3d3f5ac P 27c2d988e75b425d98222024c0ad2b8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:46:52.260097 3386 raft_consensus.cc:2258] T bcefabf94c304421a1fee661d3d3f5ac P 27c2d988e75b425d98222024c0ad2b8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:46:52.264096 3387 ts_tablet_manager.cc:1918] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:46:52.264215 3387 log.cc:1196] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/bcefabf94c304421a1fee661d3d3f5ac
I20260811 11:46:52.264631 3387 ts_tablet_manager.cc:1939] T bcefabf94c304421a1fee661d3d3f5ac P 4cf9d13ef9394f2ca910c3da06066ff3: Deleting consensus metadata
I20260811 11:46:52.266067 2717 catalog_manager.cc:4841] TS 4cf9d13ef9394f2ca910c3da06066ff3 (127.20.244.67:36297): tablet bcefabf94c304421a1fee661d3d3f5ac (table test-table [id=977daaecf02d47249d2d37db2db13e5f]) successfully deleted
I20260811 11:46:52.267551 3386 ts_tablet_manager.cc:1905] T bcefabf94c304421a1fee661d3d3f5ac P 27c2d988e75b425d98222024c0ad2b8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:46:52.270932 3386 ts_tablet_manager.cc:1918] T bcefabf94c304421a1fee661d3d3f5ac P 27c2d988e75b425d98222024c0ad2b8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:46:52.271047 3386 log.cc:1196] T bcefabf94c304421a1fee661d3d3f5ac P 27c2d988e75b425d98222024c0ad2b8b: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/bcefabf94c304421a1fee661d3d3f5ac
I20260811 11:46:52.271411 3386 ts_tablet_manager.cc:1939] T bcefabf94c304421a1fee661d3d3f5ac P 27c2d988e75b425d98222024c0ad2b8b: Deleting consensus metadata
I20260811 11:46:52.272889 2721 catalog_manager.cc:4841] TS 27c2d988e75b425d98222024c0ad2b8b (127.20.244.66:34387): tablet bcefabf94c304421a1fee661d3d3f5ac (table test-table [id=977daaecf02d47249d2d37db2db13e5f]) successfully deleted
W20260811 11:46:52.281605 2717 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.244.65:33431 (error 108)
I20260811 11:46:52.283557 3354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:46:52.283201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:33431 (local address 127.0.0.1:58264)
0811 11:46:52.283358 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 11:46:52.283454 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.65:33431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 11:46:52.283634 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 3012
W20260811 11:46:52.290832 2717 catalog_manager.cc:4584] TS 06ccfdc5d2014e30adb47976e6df5129 (127.20.244.65:33431): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bcefabf94c304421a1fee661d3d3f5ac: Network error: Client connection negotiation failed: client connection to 127.20.244.65:33431: connect: Connection refused (error 111)
I20260811 11:46:52.305946 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 3172
I20260811 11:46:52.317422 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 2696
I20260811 11:46:52.328023 21457 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 11:46:52.673415 21457 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 11:46:52.673578 21457 mini_ranger.cc:66] Stopping Ranger...
I20260811 11:46:53.031071 21457 mini_ranger.cc:68] Stopped Ranger
2026-08-11 11:46:53.031 UTC [2182] LOG: received smart shutdown request
2026-08-11 11:46:53.035 UTC [2182] LOG: background worker "logical replication launcher" (PID 2198) exited with exit code 1
2026-08-11 11:46:53.035 UTC [2190] LOG: shutting down
2026-08-11 11:46:53.209 UTC [2182] LOG: database system is shut down
2026-08-11T11:46:53Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (50397 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:46:53 dist-test-slave-vkjp krb5kdc[3401](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:46:53 dist-test-slave-vkjp krb5kdc[3401](info): set up 2 sockets
Aug 11 11:46:53 dist-test-slave-vkjp krb5kdc[3401](info): commencing operation
krb5kdc: starting...
W20260811 11:46:54.466662 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:46:54 dist-test-slave-vkjp krb5kdc[3401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:46:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:46:54Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.20.244.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.20.244.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.20.244.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/rangeradmin_127.20.244.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.20.244.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/rangeradmin_127.20.244.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.20.244.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.20.244.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.20.244.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/rangerlookup_127.20.244.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.20.244.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/rangerlookup_127.20.244.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.244.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.20.244.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.244.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/HTTP_127.20.244.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.244.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/HTTP_127.20.244.84@KRBTEST.COM.keytab.
I20260811 11:46:54.646775 21457 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskVpoijE/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/postgres -l logfile start
2026-08-11 11:46:57.219 UTC [3440] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 11:46:57.219 UTC [3440] LOG: listening on IPv4 address "127.20.244.84", port 53413
2026-08-11 11:46:57.222 UTC [3440] LOG: listening on Unix socket "/tmp/.s.PGSQL.53413"
2026-08-11 11:46:57.244 UTC [3443] LOG: database system was shut down at 2026-08-11 11:46:55 UTC
2026-08-11 11:46:57.249 UTC [3440] LOG: database system is ready to accept connections
I20260811 11:46:58.298152 21457 mini_postgres.cc:96] Postgres bound to 53413
2026-08-11 11:46:58.305 UTC [3455] FATAL: database "slave" does not exist
127.20.244.84:53413 - accepting connections
I20260811 11:46:58.306334 21457 mini_ranger.cc:161] Starting Ranger...
I20260811 11:46:58.322285 21457 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 11:46:58.852751 21457 mini_ranger.cc:87] Created ranger Postgres database
I20260811 11:46:58.852855 21457 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ranger-admin
2026-08-11 11:46:59,145 [I] DB FLAVOR :POSTGRES
2026-08-11 11:46:59,145 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 11:46:59,145 [I] Checking connection..
2026-08-11 11:46:59,145 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 11:46:59,405 [I] Checking connection passed.
2026-08-11 11:46:59,405 [I] --------- Verifying version history table ---------
2026-08-11 11:46:59,405 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 11:46:59,673 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 11:46:59,673 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 11:46:59,943 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 11:46:59,943 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 11:46:59,943 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 11:47:00.199 UTC [3532] WARNING: there is no transaction in progress
2026-08-11 11:47:00,206 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 11:47:00,207 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 11:47:00,462 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 11:47:00,462 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 11:47:00,463 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 11:47:00,725 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 11:47:00,985 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-vkjp.c.gcp-upstream.internal','N') ;"
2026-08-11 11:47:01,249 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 11:47:01,510 [I] Table x_portal_user does not exist in database ranger
2026-08-11 11:47:01,511 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 11:47:01,781 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 11:47:01,781 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 11:47:02,031 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 11:47:02,298 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 11:47:02,298 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 11:47:03.325 UTC [3668] WARNING: there is no transaction in progress
2026-08-11 11:47:03.340 UTC [3668] WARNING: there is no transaction in progress
2026-08-11 11:47:03.357 UTC [3668] WARNING: there is no transaction in progress
2026-08-11 11:47:03.372 UTC [3668] WARNING: there is no transaction in progress
2026-08-11 11:47:03.391 UTC [3668] WARNING: there is no transaction in progress
2026-08-11 11:47:03.412 UTC [3668] WARNING: there is no transaction in progress
2026-08-11 11:47:03.471 UTC [3668] WARNING: there is no transaction in progress
2026-08-11 11:47:03.479 UTC [3668] WARNING: there is no transaction in progress
2026-08-11 11:47:03.493 UTC [3668] WARNING: there is no transaction in progress
2026-08-11 11:47:03.503 UTC [3668] WARNING: there is no transaction in progress
2026-08-11 11:47:03.514 UTC [3668] WARNING: there is no transaction in progress
2026-08-11 11:47:03.530 UTC [3668] WARNING: there is no transaction in progress
2026-08-11 11:47:03.541 UTC [3668] WARNING: there is no transaction in progress
2026-08-11 11:47:03.548 UTC [3668] WARNING: there is no transaction in progress
2026-08-11 11:47:03.555 UTC [3668] WARNING: there is no transaction in progress
2026-08-11 11:47:03.562 UTC [3668] WARNING: there is no transaction in progress
2026-08-11 11:47:04,230 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 11:47:04,231 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 11:47:04,488 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 11:47:04,488 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 11:47:04,774 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 11:47:04,775 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 11:47:05,030 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 11:47:05,031 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 11:47:05,305 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 11:47:05,569 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-vkjp.c.gcp-upstream.internal';"
2026-08-11 11:47:05,820 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 11:47:05,821 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 11:47:06,088 [I] DB_PATCHES have already been applied
I20260811 11:47:06.094456 21457 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ranger-admin:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskVpoijE/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 11:47:06.094528 21457 mini_ranger.cc:193] Using host: 127.20.244.84
I20260811 11:47:06.098867 21457 mini_ranger.cc:227] Ranger admin URL: http://127.20.244.84:44257
Aug 11, 2026 11:47:06 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 11:47:06 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 11:47:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 11:47:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 11:47:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 11:47:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 11:47:06 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 11:47:07.323523 21457 mini_ranger.cc:160] Time spent starting Ranger: real 9.017s user 0.000s sys 0.012s
Aug 11, 2026 11:47:28 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 11:47:28 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 11, 2026 11:47:28 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 11:47:28 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 11:47:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 11:47:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 11:47:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 11:47:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 11:47:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 11:47:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 11:47:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 11:47:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 11:47:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 11:47:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 11:47:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 11:47:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 11:47:28 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 11:47:29 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 11:47:29.701727 21457 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.20.244.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.20.244.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.20.244.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/rangerkms_127.20.244.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.20.244.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/rangerkms_127.20.244.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.244.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.20.244.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.244.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/HTTP_127.20.244.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.244.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/HTTP_127.20.244.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 11:47:29 dist-test-slave-vkjp krb5kdc[3401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448849, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 11:47:29.797166 21457 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 11:47:29.808085 21457 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 11:47:30.737627 21457 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 11:47:30.737725 21457 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ranger-kms
I20260811 11:47:30.737749 21457 mini_ranger_kms.cc:227] Using postgres at 127.20.244.84:53413
2026-08-11 11:47:30,916 [I] DB FLAVOR :POSTGRES
2026-08-11 11:47:30,917 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 11:47:30,917 [I] Checking connection
2026-08-11 11:47:30,917 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 11:47:31,180 [I] connection success
2026-08-11 11:47:31,180 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 11:47:31,180 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 11:47:31,180 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 11:47:31,417 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 11:47:31,417 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 11:47:31,417 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 11:47:31,417 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.244.84:53413/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 11:47:31,706 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 11:47:32.170823 21457 mini_ranger_kms.cc:310] Created kms service
I20260811 11:47:32.388281 21457 mini_ranger_kms.cc:326] Created kudu user
I20260811 11:47:32.439496 21457 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 11:47:32 dist-test-slave-vkjp krb5kdc[3401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448849, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
I20260811 11:47:32.828485 21457 mini_ranger_kms.cc:384] Added ranger policy
I20260811 11:47:32.828779 21457 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ranger-kms:/tmp/dist-test-taskVpoijE/build/debug/bin/postgresql.jar:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskVpoijE/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 11:47:32.828810 21457 mini_ranger_kms.cc:240] Using host: 127.20.244.84
I20260811 11:47:32.833410 21457 mini_ranger_kms.cc:276] Ranger KMS PID: 3891
I20260811 11:47:32.833494 21457 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.20.244.84:38121
Aug 11, 2026 11:47:33 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 11:47:33 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 11:47:34 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 11:47:34 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 11:47:34 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 11:47:34 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 11:47:35 dist-test-slave-vkjp krb5kdc[3401](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786448855, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.244.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:35.395418 21457 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.598s user 0.009s sys 0.154s
I20260811 11:47:35.395561 21457 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 11:47:35.395641 21457 mini_ranger_kms.cc:401] 127.20.244.84:38121/kms/v1/keys
Aug 11 11:47:35 dist-test-slave-vkjp krb5kdc[3401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448855, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.244.84@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
Aug 11 11:47:36 dist-test-slave-vkjp krb5kdc[3401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448855, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.244.84@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
Aug 11 11:47:38 dist-test-slave-vkjp krb5kdc[3401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:47:38.407940 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:33801
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:39433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:33801
--ranger_config_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.244.84:38121/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:47:38.535229 3957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:38.535616 3957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:38.535692 3957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:38.540071 3957 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:47:38.540150 3957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:38.540170 3957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:38.540189 3957 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:47:38.540203 3957 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:47:38.546308 3957 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:39433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/wal
--ranger_kms_url=127.20.244.84:38121/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:33801
--ranger_config_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:33801
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:38.547573 3957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:38.548724 3957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:38.558130 3962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:38.558120 3963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:38.558125 3965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:38.558364 3957 server_base.cc:1034] running on GCE node
I20260811 11:47:38.559295 3957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:38.560549 3957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:38.561789 3957 hybrid_clock.cc:648] HybridClock initialized: now 1786448858561753 us; error 36 us; skew 500 ppm
Aug 11 11:47:38 dist-test-slave-vkjp krb5kdc[3401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448858, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:38.570876 3957 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:47:38.572220 3957 webserver.cc:460] Webserver started at http://127.20.244.126:36387/ using document root <none> and password file <none>
I20260811 11:47:38.572912 3957 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:38.573014 3957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:47:38.573305 3957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 11:47:38 dist-test-slave-vkjp krb5kdc[3401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448858, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
I20260811 11:47:38.625308 3957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "aa606130230c4252b4899f7d720170bd"
format_stamp: "Formatted at 2026-08-11 11:47:38 on dist-test-slave-vkjp"
server_key: "9b620cae9bbf8c2039e0bcb0bde17471"
server_key_iv: "d8843b05f58c7d9e21b5524c8fe85212"
server_key_version: "kuduclusterkey@0"
I20260811 11:47:38.626089 3957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "aa606130230c4252b4899f7d720170bd"
format_stamp: "Formatted at 2026-08-11 11:47:38 on dist-test-slave-vkjp"
server_key: "9b620cae9bbf8c2039e0bcb0bde17471"
server_key_iv: "d8843b05f58c7d9e21b5524c8fe85212"
server_key_version: "kuduclusterkey@0"
I20260811 11:47:38.631346 3957 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 11:47:38.647797 3972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:38.649375 3957 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 11:47:38.649503 3957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "aa606130230c4252b4899f7d720170bd"
format_stamp: "Formatted at 2026-08-11 11:47:38 on dist-test-slave-vkjp"
server_key: "9b620cae9bbf8c2039e0bcb0bde17471"
server_key_iv: "d8843b05f58c7d9e21b5524c8fe85212"
server_key_version: "kuduclusterkey@0"
I20260811 11:47:38.649679 3957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:38.662868 3957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:38.666184 3957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:38.666409 3957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:38.675010 3957 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:33801
I20260811 11:47:38.675014 4038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:33801 every 8 connection(s)
I20260811 11:47:38.676162 3957 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:47:38.678369 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 3957
I20260811 11:47:38.678536 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:47:38.678862 21457 external_mini_cluster.cc:1428] Setting key b1482684b195a60a13ca969a97cb5e5b
I20260811 11:47:38.679703 4039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:47:38.687361 4039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd: Bootstrap starting.
I20260811 11:47:38.690412 4039 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd: Neither blocks nor log segments found. Creating new log.
Aug 11 11:47:38 dist-test-slave-vkjp krb5kdc[3401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:47:38.691427 4039 log.cc:824] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd: Log is configured to *not* fsync() on all Append() calls
I20260811 11:47:38.694275 4039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd: No bootstrap required, opened a new log
I20260811 11:47:38.697425 4043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:38.680520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56290 (local address 127.20.244.126:33801)
0811 11:47:38.681066 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:38.681088 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:38.681139 (+ 51us) server_negotiation.cc:407] Connection header received
0811 11:47:38.682146 (+ 1007us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:38.682174 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:38.682676 (+ 502us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:38.683144 (+ 468us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:38.684149 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:38.685762 (+ 1613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:38.687025 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:38.687836 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:38.688016 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:38.691448 (+ 3432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:38.691457 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:38.691477 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:38.691520 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:38.694146 (+ 2626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:38.694794 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:38.694799 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:38.694805 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:38.694919 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:38.695300 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:38.695304 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:38.695308 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:38.695745 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:38.695981 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:38.696302 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 11:47:38.696637 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":166,"threads_started":1}
I20260811 11:47:38.698616 4039 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa606130230c4252b4899f7d720170bd" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33801 } }
I20260811 11:47:38.698937 4039 raft_consensus.cc:374] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:47:38.699033 4039 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa606130230c4252b4899f7d720170bd, State: Initialized, Role: FOLLOWER
I20260811 11:47:38.699599 4039 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa606130230c4252b4899f7d720170bd" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33801 } }
I20260811 11:47:38.699783 4039 raft_consensus.cc:388] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:47:38.699875 4039 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:47:38.699978 4039 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:47:38.701288 4039 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa606130230c4252b4899f7d720170bd" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33801 } }
I20260811 11:47:38.701675 4039 leader_election.cc:302] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa606130230c4252b4899f7d720170bd; no voters:
I20260811 11:47:38.702070 4039 leader_election.cc:288] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:47:38.702243 4047 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:47:38.702636 4047 raft_consensus.cc:686] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [term 1 LEADER]: Becoming Leader. State: Replica: aa606130230c4252b4899f7d720170bd, State: Running, Role: LEADER
I20260811 11:47:38.703007 4047 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa606130230c4252b4899f7d720170bd" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33801 } }
I20260811 11:47:38.703523 4039 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:47:38.704958 4050 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa606130230c4252b4899f7d720170bd. Latest consensus state: current_term: 1 leader_uuid: "aa606130230c4252b4899f7d720170bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa606130230c4252b4899f7d720170bd" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33801 } } }
I20260811 11:47:38.705097 4050 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [sys.catalog]: This master's current role is: LEADER
I20260811 11:47:38.705479 4048 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa606130230c4252b4899f7d720170bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa606130230c4252b4899f7d720170bd" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33801 } } }
I20260811 11:47:38.705566 4048 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [sys.catalog]: This master's current role is: LEADER
I20260811 11:47:38.706022 4061 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:47:38.706032 4039 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 11:47:38.713821 4061 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:47:38.721717 4061 catalog_manager.cc:1347] Generated new cluster ID: a5eedb32ca154f6eb10488f845a8cd57
I20260811 11:47:38.721800 4061 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:47:38.743253 4061 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:47:38.744737 4061 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:47:38.753211 4061 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd: Generated new TSK 0
I20260811 11:47:38.754160 4061 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.244.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
I20260811 11:47:39.495261 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.244.84:38121/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:33801
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:39433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:47:39.667327 4095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:39.667634 4095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:39.667724 4095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:39.671931 4095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:39.671996 4095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:39.672057 4095 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:47:39.679484 4095 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:39433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.20.244.84:38121/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:33801
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4095
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:39.680974 4095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:39.682355 4095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:39.694849 4102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:39.694921 4105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:39.696791 4103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:39.697712 4095 server_base.cc:1034] running on GCE node
I20260811 11:47:39.698254 4095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:39.699168 4095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:39.700369 4095 hybrid_clock.cc:648] HybridClock initialized: now 1786448859700336 us; error 51 us; skew 500 ppm
Aug 11 11:47:39 dist-test-slave-vkjp krb5kdc[3401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448859, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:39.704181 4095 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:47:39.705415 4095 webserver.cc:460] Webserver started at http://127.20.244.65:38011/ using document root <none> and password file <none>
I20260811 11:47:39.706087 4095 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:39.706188 4095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:47:39.706444 4095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 11:47:39 dist-test-slave-vkjp krb5kdc[3401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448859, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
I20260811 11:47:39.722798 4095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "f0765d4e9148449b87c550d30f337e43"
format_stamp: "Formatted at 2026-08-11 11:47:39 on dist-test-slave-vkjp"
server_key: "6f7371e1c911657c9800d82f48a48918"
server_key_iv: "50ad84faeb118d6521e0ce32fe3db37e"
server_key_version: "kuduclusterkey@0"
I20260811 11:47:39.723595 4095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "f0765d4e9148449b87c550d30f337e43"
format_stamp: "Formatted at 2026-08-11 11:47:39 on dist-test-slave-vkjp"
server_key: "6f7371e1c911657c9800d82f48a48918"
server_key_iv: "50ad84faeb118d6521e0ce32fe3db37e"
server_key_version: "kuduclusterkey@0"
I20260811 11:47:39.729923 4095 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 11:47:39.747516 4115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:39.749352 4095 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260811 11:47:39.749497 4095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "f0765d4e9148449b87c550d30f337e43"
format_stamp: "Formatted at 2026-08-11 11:47:39 on dist-test-slave-vkjp"
server_key: "6f7371e1c911657c9800d82f48a48918"
server_key_iv: "50ad84faeb118d6521e0ce32fe3db37e"
server_key_version: "kuduclusterkey@0"
I20260811 11:47:39.749641 4095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:39.780839 4095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:39.784466 4095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:39.784675 4095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:39.785429 4095 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:47:39.786548 4095 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:47:39.786618 4095 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:39.786674 4095 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:47:39.786698 4095 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:39.798623 4095 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:40057
I20260811 11:47:39.800016 4095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:47:39.809235 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 4095
I20260811 11:47:39.809391 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:47:39.809715 21457 external_mini_cluster.cc:1428] Setting key 45595bcbe33b4f56b22af205628ea332
I20260811 11:47:39.816780 4255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:40057 every 8 connection(s)
Aug 11 11:47:39 dist-test-slave-vkjp krb5kdc[3401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448859, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:47:39.827798 4259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:39.806149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33801 (local address 127.20.244.65:34939)
0811 11:47:39.807935 (+ 1786us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:39.807995 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:39.809092 (+ 1097us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:39.813716 (+ 4624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:39.813729 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:39.814122 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:39.814867 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:39.814890 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:39.816197 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:39.816202 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:39.817629 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:39.817642 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:39.818378 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:39.818382 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:39.818605 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:39.819441 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:39.819464 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:39.821368 (+ 1904us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:39.824006 (+ 2638us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:39.824014 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:39.824033 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:39.824422 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:39.824769 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:39.824773 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:39.824774 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:39.824989 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:39.825571 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:39.825578 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:39.825943 (+ 365us) client_negotiation.cc:769] Sending connection context
0811 11:47:39.826171 (+ 228us) client_negotiation.cc:240] Negotiation successful
0811 11:47:39.826571 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1546,"thread_start_us":155,"threads_started":1}
I20260811 11:47:39.828652 4260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:39.807370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:34939 (local address 127.20.244.126:33801)
0811 11:47:39.807646 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:39.807651 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:39.809476 (+ 1825us) server_negotiation.cc:407] Connection header received
0811 11:47:39.809536 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:39.809539 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:39.809597 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:39.809680 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:39.815065 (+ 5385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:39.816022 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:39.817793 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:39.818160 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:39.818313 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:39.821599 (+ 3286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:39.821604 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:39.821607 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:39.821638 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:39.823852 (+ 2214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:39.824551 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:39.824555 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:39.824557 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:39.824657 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:39.825120 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:39.825124 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:39.825126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:39.825405 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:39.825510 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:39.828318 (+ 2808us) server_negotiation.cc:299] Negotiation successful
0811 11:47:39.828475 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":71,"threads_started":1}
I20260811 11:47:39.829918 4256 heartbeater.cc:347] Connected to a master server at 127.20.244.126:33801
I20260811 11:47:39.830189 4256 heartbeater.cc:464] Registering TS with master...
I20260811 11:47:39.830790 4256 heartbeater.cc:511] Master 127.20.244.126:33801 requested a full tablet report, sending...
I20260811 11:47:39.832680 3992 ts_manager.cc:194] Registered new tserver with Master: f0765d4e9148449b87c550d30f337e43 (127.20.244.65:40057)
WARNING: no policy specified for kudu/127.20.244.66@KRBTEST.COM; defaulting to no policy
I20260811 11:47:39.834270 3992 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:34939
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
I20260811 11:47:39.860340 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.244.84:38121/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:33801
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:39433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 11:47:39 dist-test-slave-vkjp krb5kdc[3401](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786448859, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 11:47:40.030323 4263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:40.030773 4263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:40.030898 4263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:40.037197 4263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:40.037286 4263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:40.037379 4263 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:47:40.045521 4263 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:39433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.20.244.84:38121/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:33801
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4263
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:40.046995 4263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:40.048451 4263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:40.061282 4269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:40.061282 4274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:40.061609 4271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:40.061949 4263 server_base.cc:1034] running on GCE node
I20260811 11:47:40.062496 4263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:40.063457 4263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:40.064683 4263 hybrid_clock.cc:648] HybridClock initialized: now 1786448860064658 us; error 37 us; skew 500 ppm
Aug 11 11:47:40 dist-test-slave-vkjp krb5kdc[3401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448860, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:40.068864 4263 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:47:40.070019 4263 webserver.cc:460] Webserver started at http://127.20.244.66:34031/ using document root <none> and password file <none>
I20260811 11:47:40.070819 4263 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:40.070979 4263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:47:40.071309 4263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 11:47:40 dist-test-slave-vkjp krb5kdc[3401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448860, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
I20260811 11:47:40.088222 4263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "a0ad197d5d484f9d9733b8f254b7d888"
format_stamp: "Formatted at 2026-08-11 11:47:40 on dist-test-slave-vkjp"
server_key: "1c572f6a8803ac46e5357f924e09129d"
server_key_iv: "fb5d9112a9695c84ad25dbf110140a5a"
server_key_version: "kuduclusterkey@0"
I20260811 11:47:40.089679 4263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "a0ad197d5d484f9d9733b8f254b7d888"
format_stamp: "Formatted at 2026-08-11 11:47:40 on dist-test-slave-vkjp"
server_key: "1c572f6a8803ac46e5357f924e09129d"
server_key_iv: "fb5d9112a9695c84ad25dbf110140a5a"
server_key_version: "kuduclusterkey@0"
I20260811 11:47:40.095347 4263 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 11:47:40.119534 4283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:40.124472 4263 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.004s sys 0.000s
I20260811 11:47:40.124681 4263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "a0ad197d5d484f9d9733b8f254b7d888"
format_stamp: "Formatted at 2026-08-11 11:47:40 on dist-test-slave-vkjp"
server_key: "1c572f6a8803ac46e5357f924e09129d"
server_key_iv: "fb5d9112a9695c84ad25dbf110140a5a"
server_key_version: "kuduclusterkey@0"
I20260811 11:47:40.124842 4263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:40.137594 4263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:40.140805 4263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:40.141040 4263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:40.141717 4263 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:47:40.142683 4263 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:47:40.142753 4263 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:40.142827 4263 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:47:40.142879 4263 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:40.154364 4263 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:41183
I20260811 11:47:40.155874 4263 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:47:40.164978 4423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:41183 every 8 connection(s)
I20260811 11:47:40.165548 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 4263
I20260811 11:47:40.165690 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:47:40.166018 21457 external_mini_cluster.cc:1428] Setting key 367d0540a229866ccf1f55b8642338b7
Aug 11 11:47:40 dist-test-slave-vkjp krb5kdc[3401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448860, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.244.67@KRBTEST.COM; defaulting to no policy
I20260811 11:47:40.181876 4260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:40.166922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:56281 (local address 127.20.244.126:33801)
0811 11:47:40.167278 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:40.167283 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:40.167737 (+ 454us) server_negotiation.cc:407] Connection header received
0811 11:47:40.168989 (+ 1252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:40.168992 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:40.169044 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:40.169095 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:40.170772 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:40.171604 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:40.173472 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:40.173836 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:40.173914 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:40.177094 (+ 3180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:40.177098 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:40.177101 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:40.177131 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:40.178997 (+ 1866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:40.179728 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:40.179732 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:40.179735 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:40.179842 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:40.180327 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:40.180331 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:40.180333 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:40.180576 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:40.180685 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:40.181532 (+ 847us) server_negotiation.cc:299] Negotiation successful
0811 11:47:40.181682 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.67@KRBTEST.COM" created.
I20260811 11:47:40.183635 4426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:40.166233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33801 (local address 127.20.244.66:56281)
0811 11:47:40.167572 (+ 1339us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:40.167634 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:40.168731 (+ 1097us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:40.169523 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:40.169532 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:40.169888 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:40.170582 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:40.170610 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:40.171777 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:40.171780 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:40.173325 (+ 1545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:40.173337 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:40.174132 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:40.174136 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:40.174347 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:40.175072 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:40.175118 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:40.176903 (+ 1785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:40.179195 (+ 2292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:40.179203 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:40.179222 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:40.179597 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:40.179969 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:40.179972 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:40.179974 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:40.180164 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:40.180746 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:40.180753 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:40.181191 (+ 438us) client_negotiation.cc:769] Sending connection context
0811 11:47:40.182101 (+ 910us) client_negotiation.cc:240] Negotiation successful
0811 11:47:40.182427 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1107,"thread_start_us":177,"threads_started":1}
I20260811 11:47:40.185299 4424 heartbeater.cc:347] Connected to a master server at 127.20.244.126:33801
I20260811 11:47:40.185587 4424 heartbeater.cc:464] Registering TS with master...
I20260811 11:47:40.186167 4424 heartbeater.cc:511] Master 127.20.244.126:33801 requested a full tablet report, sending...
I20260811 11:47:40.187348 3992 ts_manager.cc:194] Registered new tserver with Master: a0ad197d5d484f9d9733b8f254b7d888 (127.20.244.66:41183)
I20260811 11:47:40.188184 3992 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:56281
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
I20260811 11:47:40.206202 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.244.84:38121/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:33801
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:39433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 11:47:40 dist-test-slave-vkjp krb5kdc[3401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448859, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
W20260811 11:47:40.356932 4429 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:40.357369 4429 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:40.357442 4429 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:40.363442 4429 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:40.363612 4429 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:40.363847 4429 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:47:40.372691 4429 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:39433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.20.244.84:38121/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:33801
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4429
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:40.374456 4429 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:40.375962 4429 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:40.390256 4436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:40.390690 4429 server_base.cc:1034] running on GCE node
W20260811 11:47:40.390606 4438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:40.390769 4435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:40.392318 4429 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:40.393034 4429 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:40.394256 4429 hybrid_clock.cc:648] HybridClock initialized: now 1786448860394215 us; error 53 us; skew 500 ppm
Aug 11 11:47:40 dist-test-slave-vkjp krb5kdc[3401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448860, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:40.397349 4429 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:47:40.398511 4429 webserver.cc:460] Webserver started at http://127.20.244.67:41399/ using document root <none> and password file <none>
I20260811 11:47:40.399201 4429 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:40.399303 4429 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:47:40.399549 4429 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 11:47:40 dist-test-slave-vkjp krb5kdc[3401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448860, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
I20260811 11:47:40.422408 4429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "1c01fd6b3e2c4c90941121d6a6c07ef5"
format_stamp: "Formatted at 2026-08-11 11:47:40 on dist-test-slave-vkjp"
server_key: "27051c38f8e3bd0e8831f46589e300b0"
server_key_iv: "169cb78d69c8953eee54654678e73429"
server_key_version: "kuduclusterkey@0"
I20260811 11:47:40.423182 4429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "1c01fd6b3e2c4c90941121d6a6c07ef5"
format_stamp: "Formatted at 2026-08-11 11:47:40 on dist-test-slave-vkjp"
server_key: "27051c38f8e3bd0e8831f46589e300b0"
server_key_iv: "169cb78d69c8953eee54654678e73429"
server_key_version: "kuduclusterkey@0"
I20260811 11:47:40.429141 4429 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260811 11:47:40.459504 4446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:40.461652 4429 fs_manager.cc:725] Time spent opening block manager: real 0.017s user 0.002s sys 0.000s
I20260811 11:47:40.461844 4429 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "1c01fd6b3e2c4c90941121d6a6c07ef5"
format_stamp: "Formatted at 2026-08-11 11:47:40 on dist-test-slave-vkjp"
server_key: "27051c38f8e3bd0e8831f46589e300b0"
server_key_iv: "169cb78d69c8953eee54654678e73429"
server_key_version: "kuduclusterkey@0"
I20260811 11:47:40.462024 4429 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:40.510136 4429 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:40.514137 4429 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:40.514433 4429 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:40.515316 4429 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:47:40.516600 4429 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:47:40.516713 4429 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:40.516839 4429 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:47:40.516916 4429 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:40.529068 4429 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:43541
I20260811 11:47:40.529189 4581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:43541 every 8 connection(s)
I20260811 11:47:40.530495 4429 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:47:40.532857 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 4429
I20260811 11:47:40.533000 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:47:40.533313 21457 external_mini_cluster.cc:1428] Setting key 0d2f3612d2c99724a21bde4fa3c92a9a
Aug 11 11:47:40 dist-test-slave-vkjp krb5kdc[3401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448860, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:47:40.548739 4260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:40.534486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:44519 (local address 127.20.244.126:33801)
0811 11:47:40.534627 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:40.534631 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:40.535120 (+ 489us) server_negotiation.cc:407] Connection header received
0811 11:47:40.536380 (+ 1260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:40.536383 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:40.536441 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:40.536495 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:40.538180 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:40.539001 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:40.540780 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:40.541146 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:40.541233 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:40.544346 (+ 3113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:40.544350 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:40.544353 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:40.544383 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:40.546130 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:40.546771 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:40.546775 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:40.546777 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:40.546894 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:40.547370 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:40.547374 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:40.547376 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:40.547613 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:40.547704 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:40.548443 (+ 739us) server_negotiation.cc:299] Negotiation successful
0811 11:47:40.548569 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 11:47:40.550469 4584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:40.533363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33801 (local address 127.20.244.67:44519)
0811 11:47:40.534929 (+ 1566us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:40.534990 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:40.536130 (+ 1140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:40.536933 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:40.536941 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:40.537299 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:40.538003 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:40.538026 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:40.539191 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:40.539194 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:40.540634 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:40.540645 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:40.541458 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:40.541463 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:40.541662 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:40.542363 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:40.542384 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:40.544154 (+ 1770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:40.546271 (+ 2117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:40.546277 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:40.546294 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:40.546649 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:40.547019 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:40.547025 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:40.547027 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:40.547244 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:40.547781 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:40.547788 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:40.548137 (+ 349us) client_negotiation.cc:769] Sending connection context
0811 11:47:40.548969 (+ 832us) client_negotiation.cc:240] Negotiation successful
0811 11:47:40.549353 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1321,"thread_start_us":167,"threads_started":1}
I20260811 11:47:40.551838 4582 heartbeater.cc:347] Connected to a master server at 127.20.244.126:33801
I20260811 11:47:40.552109 4582 heartbeater.cc:464] Registering TS with master...
I20260811 11:47:40.552745 4582 heartbeater.cc:511] Master 127.20.244.126:33801 requested a full tablet report, sending...
I20260811 11:47:40.553923 3992 ts_manager.cc:194] Registered new tserver with Master: 1c01fd6b3e2c4c90941121d6a6c07ef5 (127.20.244.67:43541)
I20260811 11:47:40.554719 3992 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:44519
I20260811 11:47:40.559732 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:47:40.560441 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 4095
I20260811 11:47:40.575130 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 4263
I20260811 11:47:40.587653 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 4429
I20260811 11:47:40.607052 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 3957
I20260811 11:47:40.620579 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:33801
--webserver_interface=127.20.244.126
--webserver_port=36387
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:39433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:33801
--ranger_config_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.244.84:38121/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.244.84:38121/kms with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:47:40.738834 4585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:40.739205 4585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:40.739286 4585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:40.743546 4585 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:47:40.743619 4585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:40.743638 4585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:40.743655 4585 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:47:40.743671 4585 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:47:40.749785 4585 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:39433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.244.84:38121/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:33801
--ranger_config_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:33801
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=36387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:40.750998 4585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:40.752099 4585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:40.761158 4591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:40.761169 4595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:40.761180 4590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:40.761231 4585 server_base.cc:1034] running on GCE node
I20260811 11:47:40.761968 4585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:40.763202 4585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:40.764389 4585 hybrid_clock.cc:648] HybridClock initialized: now 1786448860764356 us; error 52 us; skew 500 ppm
Aug 11 11:47:40 dist-test-slave-vkjp krb5kdc[3401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448860, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:40.767391 4585 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:47:40.768484 4585 webserver.cc:460] Webserver started at http://127.20.244.126:36387/ using document root <none> and password file <none>
I20260811 11:47:40.769018 4585 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:40.769085 4585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 11:47:40 dist-test-slave-vkjp krb5kdc[3401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448860, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
I20260811 11:47:40.844041 4585 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 11:47:40.846665 4608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:40.848213 4585 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 11:47:40.848373 4585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "aa606130230c4252b4899f7d720170bd"
format_stamp: "Formatted at 2026-08-11 11:47:38 on dist-test-slave-vkjp"
server_key: "9b620cae9bbf8c2039e0bcb0bde17471"
server_key_iv: "d8843b05f58c7d9e21b5524c8fe85212"
server_key_version: "kuduclusterkey@0"
I20260811 11:47:40.848964 4585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:40.876422 4585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:40.879745 4585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:40.879974 4585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:40.887801 4585 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:33801
I20260811 11:47:40.887826 4669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:33801 every 8 connection(s)
I20260811 11:47:40.889004 4585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:47:40.889928 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 4585
I20260811 11:47:40.890390 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.244.84:38121/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:40057
--local_ip_for_outbound_sockets=127.20.244.65
--tserver_master_addrs=127.20.244.126:33801
--webserver_port=38011
--webserver_interface=127.20.244.65
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:39433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.244.84:38121/kms with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:47:40.893818 4670 sys_catalog.cc:263] Verifying existing consensus state
I20260811 11:47:40.895660 4670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd: Bootstrap starting.
I20260811 11:47:40.913079 4670 log.cc:824] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd: Log is configured to *not* fsync() on all Append() calls
I20260811 11:47:40.919981 4670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:47:40.920441 4670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd: Bootstrap complete.
I20260811 11:47:40.924728 4670 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa606130230c4252b4899f7d720170bd" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33801 } }
I20260811 11:47:40.925325 4670 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa606130230c4252b4899f7d720170bd, State: Initialized, Role: FOLLOWER
I20260811 11:47:40.926069 4670 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa606130230c4252b4899f7d720170bd" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33801 } }
I20260811 11:47:40.926268 4670 raft_consensus.cc:388] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:47:40.926373 4670 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:47:40.926502 4670 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [term 1 FOLLOWER]: Advancing to term 2
I20260811 11:47:40.928643 4670 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa606130230c4252b4899f7d720170bd" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33801 } }
I20260811 11:47:40.928992 4670 leader_election.cc:302] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa606130230c4252b4899f7d720170bd; no voters:
I20260811 11:47:40.929327 4670 leader_election.cc:288] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 11:47:40.929469 4674 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [term 2 FOLLOWER]: Leader election won for term 2
I20260811 11:47:40.929708 4674 raft_consensus.cc:686] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [term 2 LEADER]: Becoming Leader. State: Replica: aa606130230c4252b4899f7d720170bd, State: Running, Role: LEADER
I20260811 11:47:40.930102 4674 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa606130230c4252b4899f7d720170bd" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33801 } }
I20260811 11:47:40.930655 4670 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:47:40.931762 4675 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "aa606130230c4252b4899f7d720170bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa606130230c4252b4899f7d720170bd" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33801 } } }
I20260811 11:47:40.931757 4677 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa606130230c4252b4899f7d720170bd. Latest consensus state: current_term: 2 leader_uuid: "aa606130230c4252b4899f7d720170bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa606130230c4252b4899f7d720170bd" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33801 } } }
I20260811 11:47:40.931947 4675 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [sys.catalog]: This master's current role is: LEADER
I20260811 11:47:40.931950 4677 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd [sys.catalog]: This master's current role is: LEADER
I20260811 11:47:40.932487 4686 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:47:40.935822 4686 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:47:40.936372 4670 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 11:47:40.936489 4686 catalog_manager.cc:1259] Loaded cluster ID: a5eedb32ca154f6eb10488f845a8cd57
I20260811 11:47:40.936535 4686 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:47:40.942317 4686 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:47:40.943877 4686 catalog_manager.cc:5879] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd: Loaded TSK: 0
I20260811 11:47:40.945398 4686 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 11:47:41.045778 4672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:41.046275 4672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:41.046403 4672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:41.053203 4672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:41.053301 4672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:41.053403 4672 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:47:41.061810 4672 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:39433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.244.84:38121/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:40057
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=38011
--tserver_master_addrs=127.20.244.126:33801
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4672
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:41.063478 4672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:41.064922 4672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:41.078035 4717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:41.078064 4716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:41.078310 4719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:41.078474 4672 server_base.cc:1034] running on GCE node
I20260811 11:47:41.079113 4672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:41.079980 4672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:41.081137 4672 hybrid_clock.cc:648] HybridClock initialized: now 1786448861081085 us; error 68 us; skew 500 ppm
Aug 11 11:47:41 dist-test-slave-vkjp krb5kdc[3401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448861, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:41.085024 4672 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:47:41.086259 4672 webserver.cc:460] Webserver started at http://127.20.244.65:38011/ using document root <none> and password file <none>
I20260811 11:47:41.087071 4672 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:41.087282 4672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 11:47:41 dist-test-slave-vkjp krb5kdc[3401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448861, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
I20260811 11:47:41.109964 4672 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.003s
I20260811 11:47:41.113232 4728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:41.115070 4672 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260811 11:47:41.115254 4672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "f0765d4e9148449b87c550d30f337e43"
format_stamp: "Formatted at 2026-08-11 11:47:39 on dist-test-slave-vkjp"
server_key: "6f7371e1c911657c9800d82f48a48918"
server_key_iv: "50ad84faeb118d6521e0ce32fe3db37e"
server_key_version: "kuduclusterkey@0"
I20260811 11:47:41.116104 4672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:41.143396 4672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:41.147339 4672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:41.147701 4672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:41.148633 4672 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:47:41.149861 4672 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:47:41.149991 4672 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:41.150142 4672 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:47:41.150336 4672 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:41.164393 4866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:40057 every 8 connection(s)
I20260811 11:47:41.164532 4672 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:40057
I20260811 11:47:41.165895 4672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:47:41.170233 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 4672
I20260811 11:47:41.170846 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.244.84:38121/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:41183
--local_ip_for_outbound_sockets=127.20.244.66
--tserver_master_addrs=127.20.244.126:33801
--webserver_port=34031
--webserver_interface=127.20.244.66
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:39433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.244.84:38121/kms with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 11:47:41 dist-test-slave-vkjp krb5kdc[3401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448861, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:47:41.188943 4870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:41.169310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33801 (local address 127.20.244.65:39601)
0811 11:47:41.170076 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:41.170135 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:41.171381 (+ 1246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:41.173370 (+ 1989us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:41.173379 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:41.173737 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:41.174379 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:41.174400 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:41.176365 (+ 1965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:41.176371 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:41.177382 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:41.177392 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:41.178506 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:41.178511 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:41.178709 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:41.179438 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:41.179464 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:41.181435 (+ 1971us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:41.184528 (+ 3093us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:41.184537 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:41.184557 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:41.184974 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:41.185487 (+ 513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:41.185493 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:41.185498 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:41.185699 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:41.186650 (+ 951us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:41.186659 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:41.187020 (+ 361us) client_negotiation.cc:769] Sending connection context
0811 11:47:41.187289 (+ 269us) client_negotiation.cc:240] Negotiation successful
0811 11:47:41.187691 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":159,"threads_started":1}
I20260811 11:47:41.191124 4869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:41.169105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:39601 (local address 127.20.244.126:33801)
0811 11:47:41.169751 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:41.169774 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:41.170288 (+ 514us) server_negotiation.cc:407] Connection header received
0811 11:47:41.171901 (+ 1613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:41.171919 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:41.172369 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:41.172705 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:41.174579 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:41.176166 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:41.177519 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:41.178329 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:41.178510 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:41.181709 (+ 3199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:41.181720 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:41.181741 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:41.181795 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:41.184357 (+ 2562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:41.185139 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:41.185148 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:41.185183 (+ 35us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:41.185356 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:41.185845 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:41.185851 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:41.185855 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:41.186436 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:41.186586 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:41.189664 (+ 3078us) server_negotiation.cc:299] Negotiation successful
0811 11:47:41.190020 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":164,"threads_started":1}
I20260811 11:47:41.193809 4867 heartbeater.cc:347] Connected to a master server at 127.20.244.126:33801
I20260811 11:47:41.194069 4867 heartbeater.cc:464] Registering TS with master...
I20260811 11:47:41.194648 4867 heartbeater.cc:511] Master 127.20.244.126:33801 requested a full tablet report, sending...
W20260811 11:47:41.197106 4867 heartbeater.cc:644] Failed to heartbeat to 127.20.244.126:33801 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 11:47:41.197254 4867 heartbeater.cc:464] Registering TS with master...
I20260811 11:47:41.197438 4867 heartbeater.cc:511] Master 127.20.244.126:33801 requested a full tablet report, sending...
I20260811 11:47:41.198307 4867 heartbeater.cc:464] Registering TS with master...
I20260811 11:47:41.198470 4867 heartbeater.cc:511] Master 127.20.244.126:33801 requested a full tablet report, sending...
W20260811 11:47:41.199296 4867 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 11:47:41.332226 4871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:41.332724 4871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:41.332872 4871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:41.338454 4871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:41.338546 4871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:41.338644 4871 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:47:41.345490 4871 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:39433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.244.84:38121/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:41183
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=34031
--tserver_master_addrs=127.20.244.126:33801
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4871
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:41.346890 4871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:41.348217 4871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:41.360841 4881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:41.360838 4878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:41.361455 4871 server_base.cc:1034] running on GCE node
W20260811 11:47:41.363235 4879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:41.363692 4871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:41.364444 4871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:41.365643 4871 hybrid_clock.cc:648] HybridClock initialized: now 1786448861365609 us; error 56 us; skew 500 ppm
Aug 11 11:47:41 dist-test-slave-vkjp krb5kdc[3401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448861, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:41.368997 4871 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:47:41.370150 4871 webserver.cc:460] Webserver started at http://127.20.244.66:34031/ using document root <none> and password file <none>
I20260811 11:47:41.370816 4871 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:41.370908 4871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 11:47:41 dist-test-slave-vkjp krb5kdc[3401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448861, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
I20260811 11:47:41.395783 4871 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20260811 11:47:41.399648 4889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:41.401435 4871 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 11:47:41.401619 4871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "a0ad197d5d484f9d9733b8f254b7d888"
format_stamp: "Formatted at 2026-08-11 11:47:40 on dist-test-slave-vkjp"
server_key: "1c572f6a8803ac46e5357f924e09129d"
server_key_iv: "fb5d9112a9695c84ad25dbf110140a5a"
server_key_version: "kuduclusterkey@0"
I20260811 11:47:41.402446 4871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:41.433845 4871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:41.437855 4871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:41.438165 4871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:41.439050 4871 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:47:41.440125 4871 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:47:41.440199 4871 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:41.440296 4871 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:47:41.440349 4871 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:41.454306 4871 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:41183
I20260811 11:47:41.454460 5030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:41183 every 8 connection(s)
I20260811 11:47:41.455874 4871 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:47:41.459443 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 4871
I20260811 11:47:41.459991 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.244.84:38121/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:43541
--local_ip_for_outbound_sockets=127.20.244.67
--tserver_master_addrs=127.20.244.126:33801
--webserver_port=41399
--webserver_interface=127.20.244.67
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:39433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.244.84:38121/kms with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 11:47:41 dist-test-slave-vkjp krb5kdc[3401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448861, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:47:41.475800 4869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:41.458235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:56817 (local address 127.20.244.126:33801)
0811 11:47:41.458389 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:41.458394 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:41.460725 (+ 2331us) server_negotiation.cc:407] Connection header received
0811 11:47:41.462156 (+ 1431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:41.462161 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:41.462230 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:41.462290 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:41.464171 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:41.465012 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:41.466799 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:41.467282 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:41.467435 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:41.470636 (+ 3201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:41.470643 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:41.470649 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:41.470691 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:41.472752 (+ 2061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:41.473827 (+ 1075us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:41.473834 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:41.473838 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:41.473937 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:41.474374 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:41.474377 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:41.474379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:41.474608 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:41.474678 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:41.475454 (+ 776us) server_negotiation.cc:299] Negotiation successful
0811 11:47:41.475602 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 11:47:41.477520 5035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:41.458941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33801 (local address 127.20.244.66:56817)
0811 11:47:41.460523 (+ 1582us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:41.460591 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:41.461858 (+ 1267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:41.462754 (+ 896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:41.462764 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:41.463211 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:41.463971 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:41.463995 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:41.465198 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:41.465202 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:41.466630 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:41.466643 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:41.467482 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:41.467487 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:41.467702 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:41.468478 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:41.468502 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:41.470407 (+ 1905us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:41.472917 (+ 2510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:41.472927 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:41.472950 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:41.473406 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:41.474070 (+ 664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:41.474073 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:41.474076 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:41.474267 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:41.474763 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:41.474771 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:41.475157 (+ 386us) client_negotiation.cc:769] Sending connection context
0811 11:47:41.476066 (+ 909us) client_negotiation.cc:240] Negotiation successful
0811 11:47:41.476434 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1300,"thread_start_us":168,"threads_started":1}
I20260811 11:47:41.478986 5031 heartbeater.cc:347] Connected to a master server at 127.20.244.126:33801
I20260811 11:47:41.479279 5031 heartbeater.cc:464] Registering TS with master...
I20260811 11:47:41.479873 5031 heartbeater.cc:511] Master 127.20.244.126:33801 requested a full tablet report, sending...
W20260811 11:47:41.481722 5031 heartbeater.cc:644] Failed to heartbeat to 127.20.244.126:33801 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 11:47:41.481854 5031 heartbeater.cc:464] Registering TS with master...
I20260811 11:47:41.482041 5031 heartbeater.cc:511] Master 127.20.244.126:33801 requested a full tablet report, sending...
I20260811 11:47:41.482977 5031 heartbeater.cc:464] Registering TS with master...
I20260811 11:47:41.483179 5031 heartbeater.cc:511] Master 127.20.244.126:33801 requested a full tablet report, sending...
W20260811 11:47:41.484071 5031 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 11:47:41.608392 5036 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:41.608896 5036 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:41.608997 5036 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:41.614108 5036 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:41.614224 5036 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:41.614338 5036 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:47:41.621196 5036 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:39433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.244.84:38121/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:43541
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=41399
--tserver_master_addrs=127.20.244.126:33801
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5036
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:41.622756 5036 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:41.624146 5036 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:41.637099 5049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:41.637104 5045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:41.638790 5046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:41.639827 5036 server_base.cc:1034] running on GCE node
I20260811 11:47:41.640385 5036 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:41.641359 5036 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:41.642634 5036 hybrid_clock.cc:648] HybridClock initialized: now 1786448861642607 us; error 45 us; skew 500 ppm
Aug 11 11:47:41 dist-test-slave-vkjp krb5kdc[3401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448861, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:41.646664 5036 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:47:41.648026 5036 webserver.cc:460] Webserver started at http://127.20.244.67:41399/ using document root <none> and password file <none>
I20260811 11:47:41.648836 5036 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:41.648962 5036 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 11:47:41 dist-test-slave-vkjp krb5kdc[3401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448861, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
I20260811 11:47:41.682464 5036 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 11:47:41.685913 5057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:41.687531 5036 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260811 11:47:41.687676 5036 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "1c01fd6b3e2c4c90941121d6a6c07ef5"
format_stamp: "Formatted at 2026-08-11 11:47:40 on dist-test-slave-vkjp"
server_key: "27051c38f8e3bd0e8831f46589e300b0"
server_key_iv: "169cb78d69c8953eee54654678e73429"
server_key_version: "kuduclusterkey@0"
I20260811 11:47:41.688521 5036 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:41.703609 5036 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:41.707530 5036 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:41.707765 5036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:41.708531 5036 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:47:41.709590 5036 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:47:41.709664 5036 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:41.709729 5036 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:47:41.709759 5036 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:41.724071 5036 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:43541
I20260811 11:47:41.724196 5192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:43541 every 8 connection(s)
I20260811 11:47:41.725378 5036 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:47:41.734597 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 5036
Aug 11 11:47:41 dist-test-slave-vkjp krb5kdc[3401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448861, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:47:41.742300 4869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:41.727478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:48871 (local address 127.20.244.126:33801)
0811 11:47:41.727617 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:41.727622 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:41.728630 (+ 1008us) server_negotiation.cc:407] Connection header received
0811 11:47:41.729751 (+ 1121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:41.729755 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:41.729819 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:41.729928 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:41.731284 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:41.732081 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:41.733893 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:41.734250 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:41.734347 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:41.737696 (+ 3349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:41.737703 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:41.737708 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:41.737741 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:41.739665 (+ 1924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:41.740326 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:41.740330 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:41.740332 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:41.740438 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:41.740900 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:41.740904 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:41.740906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:41.741142 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:41.741243 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:41.741983 (+ 740us) server_negotiation.cc:299] Negotiation successful
0811 11:47:41.742117 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 11:47:41.743525 5196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:41.727941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:33801 (local address 127.20.244.67:48871)
0811 11:47:41.728444 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:41.728511 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:41.729523 (+ 1012us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:41.730121 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:41.730129 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:41.730538 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:41.731053 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:41.731067 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:41.732269 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:41.732272 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:41.733737 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:41.733749 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:41.734609 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:41.734613 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:41.734933 (+ 320us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:41.735743 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:41.735767 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:41.737521 (+ 1754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:41.739793 (+ 2272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:41.739802 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:41.739822 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:41.740191 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:41.740555 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:41.740558 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:41.740561 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:41.740772 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:41.741304 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:41.741311 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:41.741677 (+ 366us) client_negotiation.cc:769] Sending connection context
0811 11:47:41.741909 (+ 232us) client_negotiation.cc:240] Negotiation successful
0811 11:47:41.742270 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":148,"threads_started":1}
I20260811 11:47:41.744827 5193 heartbeater.cc:347] Connected to a master server at 127.20.244.126:33801
I20260811 11:47:41.745088 5193 heartbeater.cc:464] Registering TS with master...
I20260811 11:47:41.745615 5193 heartbeater.cc:511] Master 127.20.244.126:33801 requested a full tablet report, sending...
W20260811 11:47:41.747582 5193 heartbeater.cc:644] Failed to heartbeat to 127.20.244.126:33801 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 11:47:41.747737 5193 heartbeater.cc:464] Registering TS with master...
I20260811 11:47:41.747965 5193 heartbeater.cc:511] Master 127.20.244.126:33801 requested a full tablet report, sending...
I20260811 11:47:41.748961 5193 heartbeater.cc:464] Registering TS with master...
I20260811 11:47:41.749202 5193 heartbeater.cc:511] Master 127.20.244.126:33801 requested a full tablet report, sending...
W20260811 11:47:41.750065 5193 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 11:47:41.752835 5197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:41.735414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39866 (local address 127.20.244.126:33801)
0811 11:47:41.736628 (+ 1214us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:41.736632 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:41.737046 (+ 414us) server_negotiation.cc:407] Connection header received
0811 11:47:41.737089 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:41.737092 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:41.737143 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:41.737748 (+ 605us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:41.738816 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:41.740554 (+ 1738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:41.742340 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:41.742646 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:41.742750 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:41.748258 (+ 5508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:41.748274 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:41.748278 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:41.748315 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:41.750780 (+ 2465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:41.751365 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:41.751368 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:41.751369 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:41.751460 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:41.751814 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:41.751818 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:41.751819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:41.752016 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:41.752182 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:41.752456 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 11:47:41.752624 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1122,"thread_start_us":117,"threads_started":1}
Aug 11 11:47:42 dist-test-slave-vkjp krb5kdc[3401](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786448862, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:42.199546 4867 heartbeater.cc:464] Registering TS with master...
I20260811 11:47:42.199882 4867 heartbeater.cc:511] Master 127.20.244.126:33801 requested a full tablet report, sending...
I20260811 11:47:42.201105 4626 ts_manager.cc:194] Registered new tserver with Master: f0765d4e9148449b87c550d30f337e43 (127.20.244.65:40057)
I20260811 11:47:42.202801 4626 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:39601
I20260811 11:47:42.484323 5031 heartbeater.cc:464] Registering TS with master...
I20260811 11:47:42.484637 5031 heartbeater.cc:511] Master 127.20.244.126:33801 requested a full tablet report, sending...
I20260811 11:47:42.485407 4626 ts_manager.cc:194] Registered new tserver with Master: a0ad197d5d484f9d9733b8f254b7d888 (127.20.244.66:41183)
I20260811 11:47:42.486208 4626 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:56817
Aug 11 11:47:42 dist-test-slave-vkjp krb5kdc[3401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448862, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
Aug 11 11:47:42 dist-test-slave-vkjp krb5kdc[3401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448862, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for HTTP/127.20.244.84@KRBTEST.COM
I20260811 11:47:42.750355 5193 heartbeater.cc:464] Registering TS with master...
I20260811 11:47:42.750741 5193 heartbeater.cc:511] Master 127.20.244.126:33801 requested a full tablet report, sending...
I20260811 11:47:42.752985 4626 ts_manager.cc:194] Registered new tserver with Master: 1c01fd6b3e2c4c90941121d6a6c07ef5 (127.20.244.67:43541)
I20260811 11:47:42.753785 4626 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:48871
I20260811 11:47:42.760236 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:47:42.773391 5220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:42.762202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39878 (local address 127.20.244.126:33801)
0811 11:47:42.763244 (+ 1042us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:42.763249 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:42.763263 (+ 14us) server_negotiation.cc:407] Connection header received
0811 11:47:42.763304 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:42.763308 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:42.763354 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:42.764343 (+ 989us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:42.764450 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:42.765337 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:42.766559 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:42.766951 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:42.767548 (+ 597us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:42.768910 (+ 1362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:42.768914 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:42.768930 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:42.768961 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:42.771074 (+ 2113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:42.771610 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:42.771613 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:42.771616 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:42.771711 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:42.772011 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:42.772014 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:42.772016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:42.772223 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:42.773024 (+ 801us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:42.773100 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 11:47:42.773222 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":966,"thread_start_us":118,"threads_started":1}
I20260811 11:47:42.781152 4626 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39878:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:47:42.786928 4626 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:47:42.831808 5231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:42.809070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:43541 (local address 127.0.0.1:38954)
0811 11:47:42.815637 (+ 6567us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:42.815698 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:42.815846 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:42.816690 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:42.816696 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:42.816724 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:47:42.816867 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:42.816874 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:42.818369 (+ 1495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:42.818373 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:42.819781 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:42.819793 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:42.831155 (+ 11362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:42.831159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:42.831296 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:42.831373 (+ 77us) client_negotiation.cc:769] Sending connection context
0811 11:47:42.831508 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 11:47:42.831651 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6367,"thread_start_us":104,"threads_started":1}
I20260811 11:47:42.832520 5230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:42.809226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38954 (local address 127.20.244.67:43541)
0811 11:47:42.815338 (+ 6112us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:42.815350 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:42.816010 (+ 660us) server_negotiation.cc:407] Connection header received
0811 11:47:42.816099 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:42.816104 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:42.816346 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:42.816500 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:47:42.817005 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:42.818216 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:42.819939 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:42.820777 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:42.820888 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:42.821080 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:42.832220 (+ 11140us) server_negotiation.cc:299] Negotiation successful
0811 11:47:42.832376 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5966,"thread_start_us":112,"threads_started":1}
I20260811 11:47:42.832726 5236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:42.815241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44348 (local address 127.20.244.65:40057)
0811 11:47:42.815698 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:42.815706 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:42.826659 (+ 10953us) server_negotiation.cc:407] Connection header received
0811 11:47:42.826776 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:42.826783 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:42.827114 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:42.827297 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:47:42.827840 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:42.829043 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:42.830452 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:42.831481 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:42.831592 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:42.832430 (+ 838us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:42.832486 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 11:47:42.832584 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":119,"threads_started":1}
I20260811 11:47:42.832268 5234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:42.810612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:40057 (local address 127.0.0.1:44348)
0811 11:47:42.826508 (+ 15896us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:42.826519 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:42.826601 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:42.827493 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:42.827496 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:42.827528 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:47:42.827671 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:42.827679 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:42.829192 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:42.829196 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:42.830297 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:42.830309 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:42.831760 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:42.831764 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:42.831911 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:42.831936 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 11:47:42.832005 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 11:47:42.832076 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15839,"mutex_wait_us":27,"spinlock_wait_cycles":2944,"thread_start_us":95,"threads_started":1}
I20260811 11:47:42.834148 5229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:42.810404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:41183 (local address 127.0.0.1:35746)
0811 11:47:42.826200 (+ 15796us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:42.826217 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:42.826321 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:42.827499 (+ 1178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:42.827502 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:42.827534 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:47:42.827666 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:42.827672 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:42.829588 (+ 1916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:42.829592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:42.830703 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:42.830714 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:42.833741 (+ 3027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:42.833744 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:42.833850 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:42.833879 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 11:47:42.833952 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 11:47:42.834019 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15700,"mutex_wait_us":4,"spinlock_wait_cycles":35840,"thread_start_us":97,"threads_started":1}
I20260811 11:47:42.836509 5112 tablet_service.cc:1467] Processing CreateTablet for tablet de4b4b1cd6f64709a8b5f163489c30d9 (DEFAULT_TABLE table=test-table [id=65c9707e08bf435f827dbea18f731381]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:47:42.836512 4769 tablet_service.cc:1467] Processing CreateTablet for tablet de4b4b1cd6f64709a8b5f163489c30d9 (DEFAULT_TABLE table=test-table [id=65c9707e08bf435f827dbea18f731381]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:47:42.837720 5112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de4b4b1cd6f64709a8b5f163489c30d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:47:42.837749 4769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de4b4b1cd6f64709a8b5f163489c30d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:47:42.837987 5235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:42.811058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35746 (local address 127.20.244.66:41183)
0811 11:47:42.826867 (+ 15809us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:42.826875 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:42.826898 (+ 23us) server_negotiation.cc:407] Connection header received
0811 11:47:42.826973 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:42.826978 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:42.827203 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:42.827348 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:47:42.828313 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:42.829448 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:42.832657 (+ 3209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:42.833450 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:42.833549 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:42.833677 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:42.837716 (+ 4039us) server_negotiation.cc:299] Negotiation successful
0811 11:47:42.837844 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15676,"thread_start_us":75,"threads_started":1}
I20260811 11:47:42.840862 4943 tablet_service.cc:1467] Processing CreateTablet for tablet de4b4b1cd6f64709a8b5f163489c30d9 (DEFAULT_TABLE table=test-table [id=65c9707e08bf435f827dbea18f731381]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:47:42.841900 4943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de4b4b1cd6f64709a8b5f163489c30d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:47:42.859727 5240 tablet_bootstrap.cc:492] T de4b4b1cd6f64709a8b5f163489c30d9 P a0ad197d5d484f9d9733b8f254b7d888: Bootstrap starting.
I20260811 11:47:42.863581 5237 tablet_bootstrap.cc:492] T de4b4b1cd6f64709a8b5f163489c30d9 P 1c01fd6b3e2c4c90941121d6a6c07ef5: Bootstrap starting.
I20260811 11:47:42.863849 5240 tablet_bootstrap.cc:654] T de4b4b1cd6f64709a8b5f163489c30d9 P a0ad197d5d484f9d9733b8f254b7d888: Neither blocks nor log segments found. Creating new log.
I20260811 11:47:42.864975 5240 log.cc:824] T de4b4b1cd6f64709a8b5f163489c30d9 P a0ad197d5d484f9d9733b8f254b7d888: Log is configured to *not* fsync() on all Append() calls
I20260811 11:47:42.866215 5237 tablet_bootstrap.cc:654] T de4b4b1cd6f64709a8b5f163489c30d9 P 1c01fd6b3e2c4c90941121d6a6c07ef5: Neither blocks nor log segments found. Creating new log.
I20260811 11:47:42.867154 5237 log.cc:824] T de4b4b1cd6f64709a8b5f163489c30d9 P 1c01fd6b3e2c4c90941121d6a6c07ef5: Log is configured to *not* fsync() on all Append() calls
I20260811 11:47:42.867427 5238 tablet_bootstrap.cc:492] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43: Bootstrap starting.
I20260811 11:47:42.869866 5238 tablet_bootstrap.cc:654] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43: Neither blocks nor log segments found. Creating new log.
I20260811 11:47:42.870251 5237 tablet_bootstrap.cc:492] T de4b4b1cd6f64709a8b5f163489c30d9 P 1c01fd6b3e2c4c90941121d6a6c07ef5: No bootstrap required, opened a new log
I20260811 11:47:42.870365 5240 tablet_bootstrap.cc:492] T de4b4b1cd6f64709a8b5f163489c30d9 P a0ad197d5d484f9d9733b8f254b7d888: No bootstrap required, opened a new log
I20260811 11:47:42.870460 5237 ts_tablet_manager.cc:1397] T de4b4b1cd6f64709a8b5f163489c30d9 P 1c01fd6b3e2c4c90941121d6a6c07ef5: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 11:47:42.870716 5240 ts_tablet_manager.cc:1397] T de4b4b1cd6f64709a8b5f163489c30d9 P a0ad197d5d484f9d9733b8f254b7d888: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260811 11:47:42.870780 5238 log.cc:824] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43: Log is configured to *not* fsync() on all Append() calls
I20260811 11:47:42.874459 5237 raft_consensus.cc:348] T de4b4b1cd6f64709a8b5f163489c30d9 P 1c01fd6b3e2c4c90941121d6a6c07ef5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c01fd6b3e2c4c90941121d6a6c07ef5" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43541 } } peers { permanent_uuid: "a0ad197d5d484f9d9733b8f254b7d888" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 41183 } } peers { permanent_uuid: "f0765d4e9148449b87c550d30f337e43" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40057 } }
I20260811 11:47:42.874745 5237 raft_consensus.cc:374] T de4b4b1cd6f64709a8b5f163489c30d9 P 1c01fd6b3e2c4c90941121d6a6c07ef5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:47:42.874797 5237 raft_consensus.cc:729] T de4b4b1cd6f64709a8b5f163489c30d9 P 1c01fd6b3e2c4c90941121d6a6c07ef5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c01fd6b3e2c4c90941121d6a6c07ef5, State: Initialized, Role: FOLLOWER
I20260811 11:47:42.875324 5237 consensus_queue.cc:260] T de4b4b1cd6f64709a8b5f163489c30d9 P 1c01fd6b3e2c4c90941121d6a6c07ef5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c01fd6b3e2c4c90941121d6a6c07ef5" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43541 } } peers { permanent_uuid: "a0ad197d5d484f9d9733b8f254b7d888" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 41183 } } peers { permanent_uuid: "f0765d4e9148449b87c550d30f337e43" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40057 } }
I20260811 11:47:42.876451 5237 ts_tablet_manager.cc:1428] T de4b4b1cd6f64709a8b5f163489c30d9 P 1c01fd6b3e2c4c90941121d6a6c07ef5: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260811 11:47:42.876837 5193 heartbeater.cc:503] Master 127.20.244.126:33801 was elected leader, sending a full tablet report...
I20260811 11:47:42.877447 5240 raft_consensus.cc:348] T de4b4b1cd6f64709a8b5f163489c30d9 P a0ad197d5d484f9d9733b8f254b7d888 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c01fd6b3e2c4c90941121d6a6c07ef5" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43541 } } peers { permanent_uuid: "a0ad197d5d484f9d9733b8f254b7d888" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 41183 } } peers { permanent_uuid: "f0765d4e9148449b87c550d30f337e43" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40057 } }
I20260811 11:47:42.877799 5240 raft_consensus.cc:374] T de4b4b1cd6f64709a8b5f163489c30d9 P a0ad197d5d484f9d9733b8f254b7d888 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:47:42.877918 5240 raft_consensus.cc:729] T de4b4b1cd6f64709a8b5f163489c30d9 P a0ad197d5d484f9d9733b8f254b7d888 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0ad197d5d484f9d9733b8f254b7d888, State: Initialized, Role: FOLLOWER
I20260811 11:47:42.878932 5240 consensus_queue.cc:260] T de4b4b1cd6f64709a8b5f163489c30d9 P a0ad197d5d484f9d9733b8f254b7d888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c01fd6b3e2c4c90941121d6a6c07ef5" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43541 } } peers { permanent_uuid: "a0ad197d5d484f9d9733b8f254b7d888" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 41183 } } peers { permanent_uuid: "f0765d4e9148449b87c550d30f337e43" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40057 } }
I20260811 11:47:42.880617 5240 ts_tablet_manager.cc:1428] T de4b4b1cd6f64709a8b5f163489c30d9 P a0ad197d5d484f9d9733b8f254b7d888: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260811 11:47:42.881054 5031 heartbeater.cc:503] Master 127.20.244.126:33801 was elected leader, sending a full tablet report...
I20260811 11:47:42.884670 5238 tablet_bootstrap.cc:492] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43: No bootstrap required, opened a new log
I20260811 11:47:42.884896 5238 ts_tablet_manager.cc:1397] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.000s
I20260811 11:47:42.888899 5238 raft_consensus.cc:348] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c01fd6b3e2c4c90941121d6a6c07ef5" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43541 } } peers { permanent_uuid: "a0ad197d5d484f9d9733b8f254b7d888" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 41183 } } peers { permanent_uuid: "f0765d4e9148449b87c550d30f337e43" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40057 } }
I20260811 11:47:42.889216 5238 raft_consensus.cc:374] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:47:42.889276 5238 raft_consensus.cc:729] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0765d4e9148449b87c550d30f337e43, State: Initialized, Role: FOLLOWER
I20260811 11:47:42.891585 5238 consensus_queue.cc:260] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c01fd6b3e2c4c90941121d6a6c07ef5" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43541 } } peers { permanent_uuid: "a0ad197d5d484f9d9733b8f254b7d888" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 41183 } } peers { permanent_uuid: "f0765d4e9148449b87c550d30f337e43" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40057 } }
I20260811 11:47:42.892762 5238 ts_tablet_manager.cc:1428] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260811 11:47:42.893119 4867 heartbeater.cc:503] Master 127.20.244.126:33801 was elected leader, sending a full tablet report...
W20260811 11:47:42.918399 4868 tablet.cc:2369] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:47:42.959124 5034 tablet.cc:2369] T de4b4b1cd6f64709a8b5f163489c30d9 P a0ad197d5d484f9d9733b8f254b7d888: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:47:42.979873 5194 tablet.cc:2369] T de4b4b1cd6f64709a8b5f163489c30d9 P 1c01fd6b3e2c4c90941121d6a6c07ef5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:47:43.118433 5248 raft_consensus.cc:482] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:47:43.118731 5248 raft_consensus.cc:504] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c01fd6b3e2c4c90941121d6a6c07ef5" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43541 } } peers { permanent_uuid: "a0ad197d5d484f9d9733b8f254b7d888" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 41183 } } peers { permanent_uuid: "f0765d4e9148449b87c550d30f337e43" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40057 } }
I20260811 11:47:43.120236 5248 leader_election.cc:288] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c01fd6b3e2c4c90941121d6a6c07ef5 (127.20.244.67:43541), a0ad197d5d484f9d9733b8f254b7d888 (127.20.244.66:41183)
I20260811 11:47:43.125017 5235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:43.120748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:38061 (local address 127.20.244.66:41183)
0811 11:47:43.120906 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:43.120913 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:43.121345 (+ 432us) server_negotiation.cc:407] Connection header received
0811 11:47:43.121482 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:43.121486 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:43.121545 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:43.121633 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:47:43.122079 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:43.122727 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:43.123915 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:43.124349 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:43.124486 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:43.124549 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:43.124771 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 11:47:43.124860 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 11:47:43.125068 5230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:43.120618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:41543 (local address 127.20.244.67:43541)
0811 11:47:43.120811 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:43.120816 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:43.121154 (+ 338us) server_negotiation.cc:407] Connection header received
0811 11:47:43.121324 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:43.121329 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:43.121403 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:43.121480 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:47:43.121973 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:43.122626 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:43.123967 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:43.124372 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:43.124514 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:43.124568 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:43.124843 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 11:47:43.124926 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 11:47:43.125095 5259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:43.120497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:43541 (local address 127.20.244.65:41543)
0811 11:47:43.121017 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:43.121032 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:43.121160 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:43.121495 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:43.121498 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:43.121518 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:47:43.121704 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:43.121715 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:43.122759 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:43.122766 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:43.123795 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:43.123806 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:43.124529 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:43.124533 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:43.124658 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:43.124677 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 11:47:43.124799 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 11:47:43.124883 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"mutex_wait_us":6,"thread_start_us":191,"threads_started":1}
I20260811 11:47:43.125514 5258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:43.120590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:41183 (local address 127.20.244.65:38061)
0811 11:47:43.121198 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:43.121216 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:43.121342 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:43.121671 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:43.121673 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:43.121689 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:47:43.121942 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:43.121952 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:43.122851 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:43.122853 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:43.123768 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:43.123779 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:43.124493 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:43.124497 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:43.124600 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:43.124660 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 11:47:43.124724 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 11:47:43.124857 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"mutex_wait_us":31,"thread_start_us":148,"threads_started":1}
I20260811 11:47:43.125929 5116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de4b4b1cd6f64709a8b5f163489c30d9" candidate_uuid: "f0765d4e9148449b87c550d30f337e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c01fd6b3e2c4c90941121d6a6c07ef5" is_pre_election: true
I20260811 11:47:43.126180 4967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de4b4b1cd6f64709a8b5f163489c30d9" candidate_uuid: "f0765d4e9148449b87c550d30f337e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0ad197d5d484f9d9733b8f254b7d888" is_pre_election: true
I20260811 11:47:43.126255 5116 raft_consensus.cc:2454] T de4b4b1cd6f64709a8b5f163489c30d9 P 1c01fd6b3e2c4c90941121d6a6c07ef5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0765d4e9148449b87c550d30f337e43 in term 0.
I20260811 11:47:43.126467 4967 raft_consensus.cc:2454] T de4b4b1cd6f64709a8b5f163489c30d9 P a0ad197d5d484f9d9733b8f254b7d888 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0765d4e9148449b87c550d30f337e43 in term 0.
I20260811 11:47:43.126884 4729 leader_election.cc:302] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c01fd6b3e2c4c90941121d6a6c07ef5, f0765d4e9148449b87c550d30f337e43; no voters:
I20260811 11:47:43.127238 5248 raft_consensus.cc:2781] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:47:43.127321 5248 raft_consensus.cc:482] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:47:43.127375 5248 raft_consensus.cc:3037] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:47:43.128453 5248 raft_consensus.cc:504] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c01fd6b3e2c4c90941121d6a6c07ef5" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43541 } } peers { permanent_uuid: "a0ad197d5d484f9d9733b8f254b7d888" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 41183 } } peers { permanent_uuid: "f0765d4e9148449b87c550d30f337e43" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40057 } }
I20260811 11:47:43.128897 5248 leader_election.cc:288] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43 [CANDIDATE]: Term 1 election: Requested vote from peers 1c01fd6b3e2c4c90941121d6a6c07ef5 (127.20.244.67:43541), a0ad197d5d484f9d9733b8f254b7d888 (127.20.244.66:41183)
I20260811 11:47:43.129281 5116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de4b4b1cd6f64709a8b5f163489c30d9" candidate_uuid: "f0765d4e9148449b87c550d30f337e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c01fd6b3e2c4c90941121d6a6c07ef5"
I20260811 11:47:43.129279 4967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de4b4b1cd6f64709a8b5f163489c30d9" candidate_uuid: "f0765d4e9148449b87c550d30f337e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0ad197d5d484f9d9733b8f254b7d888"
I20260811 11:47:43.129407 5116 raft_consensus.cc:3037] T de4b4b1cd6f64709a8b5f163489c30d9 P 1c01fd6b3e2c4c90941121d6a6c07ef5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:47:43.129431 4967 raft_consensus.cc:3037] T de4b4b1cd6f64709a8b5f163489c30d9 P a0ad197d5d484f9d9733b8f254b7d888 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:47:43.130499 5116 raft_consensus.cc:2454] T de4b4b1cd6f64709a8b5f163489c30d9 P 1c01fd6b3e2c4c90941121d6a6c07ef5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0765d4e9148449b87c550d30f337e43 in term 1.
I20260811 11:47:43.130502 4967 raft_consensus.cc:2454] T de4b4b1cd6f64709a8b5f163489c30d9 P a0ad197d5d484f9d9733b8f254b7d888 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0765d4e9148449b87c550d30f337e43 in term 1.
I20260811 11:47:43.130838 4729 leader_election.cc:302] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c01fd6b3e2c4c90941121d6a6c07ef5, f0765d4e9148449b87c550d30f337e43; no voters:
I20260811 11:47:43.131212 5248 raft_consensus.cc:2781] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:47:43.131534 5248 raft_consensus.cc:686] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43 [term 1 LEADER]: Becoming Leader. State: Replica: f0765d4e9148449b87c550d30f337e43, State: Running, Role: LEADER
I20260811 11:47:43.131901 5248 consensus_queue.cc:237] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c01fd6b3e2c4c90941121d6a6c07ef5" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43541 } } peers { permanent_uuid: "a0ad197d5d484f9d9733b8f254b7d888" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 41183 } } peers { permanent_uuid: "f0765d4e9148449b87c550d30f337e43" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40057 } }
I20260811 11:47:43.135340 4625 catalog_manager.cc:5495] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0765d4e9148449b87c550d30f337e43 (127.20.244.65). New cstate: current_term: 1 leader_uuid: "f0765d4e9148449b87c550d30f337e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c01fd6b3e2c4c90941121d6a6c07ef5" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0ad197d5d484f9d9733b8f254b7d888" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 41183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0765d4e9148449b87c550d30f337e43" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 40057 } health_report { overall_health: HEALTHY } } }
I20260811 11:47:43.185089 5236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:43.181270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44354 (local address 127.20.244.65:40057)
0811 11:47:43.181424 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:43.181428 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:43.181445 (+ 17us) server_negotiation.cc:407] Connection header received
0811 11:47:43.181547 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:43.181549 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:43.181606 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:43.181723 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:47:43.182010 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:43.182567 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:43.183539 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:43.183757 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:43.183870 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:43.184192 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:47:43.184651 (+ 459us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:47:43.184793 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:43.184875 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 11:47:43.184935 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 11:47:43.191325 4967 raft_consensus.cc:1261] T de4b4b1cd6f64709a8b5f163489c30d9 P a0ad197d5d484f9d9733b8f254b7d888 [term 1 FOLLOWER]: Refusing update from remote peer f0765d4e9148449b87c550d30f337e43: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:47:43.191325 5116 raft_consensus.cc:1261] T de4b4b1cd6f64709a8b5f163489c30d9 P 1c01fd6b3e2c4c90941121d6a6c07ef5 [term 1 FOLLOWER]: Refusing update from remote peer f0765d4e9148449b87c550d30f337e43: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:47:43.192085 5261 consensus_queue.cc:1035] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c01fd6b3e2c4c90941121d6a6c07ef5" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 43541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:47:43.192365 5248 consensus_queue.cc:1035] T de4b4b1cd6f64709a8b5f163489c30d9 P f0765d4e9148449b87c550d30f337e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0ad197d5d484f9d9733b8f254b7d888" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 41183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:47:43.209971 4625 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:47:43.210178 4625 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:47:43.212858 4625 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aa606130230c4252b4899f7d720170bd: Sending DeleteTablet for 3 replicas of tablet de4b4b1cd6f64709a8b5f163489c30d9
I20260811 11:47:43.213841 5112 tablet_service.cc:1514] Processing DeleteTablet for tablet de4b4b1cd6f64709a8b5f163489c30d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:47:43 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:38954
I20260811 11:47:43.213845 4943 tablet_service.cc:1514] Processing DeleteTablet for tablet de4b4b1cd6f64709a8b5f163489c30d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:47:43 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:35746
I20260811 11:47:43.214504 5276 tablet_replica.cc:330] T de4b4b1cd6f64709a8b5f163489c30d9 P 1c01fd6b3e2c4c90941121d6a6c07ef5: stopping tablet replica
I20260811 11:47:43.214881 4769 tablet_service.cc:1514] Processing DeleteTablet for tablet de4b4b1cd6f64709a8b5f163489c30d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:47:43 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:44348
I20260811 11:47:43.214941 5276 raft_consensus.cc:2229] T de4b4b1cd6f64709a8b5f163489c30d9 P 1c01fd6b3e2c4c90941121d6a6c07ef5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:47:43.215113 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 4672
I20260811 11:47:43.218523 5278 tablet_replica.cc:330] T de4b4b1cd6f64709a8b5f163489c30d9 P a0ad197d5d484f9d9733b8f254b7d888: stopping tablet replica
I20260811 11:47:43.218689 5276 raft_consensus.cc:2258] T de4b4b1cd6f64709a8b5f163489c30d9 P 1c01fd6b3e2c4c90941121d6a6c07ef5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:47:43.218932 5278 raft_consensus.cc:2229] T de4b4b1cd6f64709a8b5f163489c30d9 P a0ad197d5d484f9d9733b8f254b7d888 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:47:43.219386 5278 raft_consensus.cc:2258] T de4b4b1cd6f64709a8b5f163489c30d9 P a0ad197d5d484f9d9733b8f254b7d888 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:47:43.220806 5278 ts_tablet_manager.cc:1905] T de4b4b1cd6f64709a8b5f163489c30d9 P a0ad197d5d484f9d9733b8f254b7d888: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:47:43.220862 5276 ts_tablet_manager.cc:1905] T de4b4b1cd6f64709a8b5f163489c30d9 P 1c01fd6b3e2c4c90941121d6a6c07ef5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:47:43.223318 5278 ts_tablet_manager.cc:1918] T de4b4b1cd6f64709a8b5f163489c30d9 P a0ad197d5d484f9d9733b8f254b7d888: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:47:43.223430 5278 log.cc:1196] T de4b4b1cd6f64709a8b5f163489c30d9 P a0ad197d5d484f9d9733b8f254b7d888: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/de4b4b1cd6f64709a8b5f163489c30d9
I20260811 11:47:43.223763 5278 ts_tablet_manager.cc:1939] T de4b4b1cd6f64709a8b5f163489c30d9 P a0ad197d5d484f9d9733b8f254b7d888: Deleting consensus metadata
I20260811 11:47:43.224432 5276 ts_tablet_manager.cc:1918] T de4b4b1cd6f64709a8b5f163489c30d9 P 1c01fd6b3e2c4c90941121d6a6c07ef5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:47:43.224556 5276 log.cc:1196] T de4b4b1cd6f64709a8b5f163489c30d9 P 1c01fd6b3e2c4c90941121d6a6c07ef5: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/de4b4b1cd6f64709a8b5f163489c30d9
I20260811 11:47:43.224944 5276 ts_tablet_manager.cc:1939] T de4b4b1cd6f64709a8b5f163489c30d9 P 1c01fd6b3e2c4c90941121d6a6c07ef5: Deleting consensus metadata
I20260811 11:47:43.225143 4611 catalog_manager.cc:4841] TS a0ad197d5d484f9d9733b8f254b7d888 (127.20.244.66:41183): tablet de4b4b1cd6f64709a8b5f163489c30d9 (table test-table [id=65c9707e08bf435f827dbea18f731381]) successfully deleted
I20260811 11:47:43.226140 4609 catalog_manager.cc:4841] TS 1c01fd6b3e2c4c90941121d6a6c07ef5 (127.20.244.67:43541): tablet de4b4b1cd6f64709a8b5f163489c30d9 (table test-table [id=65c9707e08bf435f827dbea18f731381]) successfully deleted
W20260811 11:47:43.227392 4609 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.244.65:40057 (error 108)
I20260811 11:47:43.227705 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 4871
I20260811 11:47:43.232560 5231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:43.232100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:40057 (local address 127.0.0.1:44368)
0811 11:47:43.232317 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:43.232432 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.65:40057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 11:47:43.232771 4609 catalog_manager.cc:4584] TS f0765d4e9148449b87c550d30f337e43 (127.20.244.65:40057): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet de4b4b1cd6f64709a8b5f163489c30d9: Network error: Client connection negotiation failed: client connection to 127.20.244.65:40057: connect: Connection refused (error 111)
I20260811 11:47:43.237839 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 5036
I20260811 11:47:43.246420 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 4585
I20260811 11:47:43.260625 21457 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 11:47:43.606557 21457 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 11:47:43.606673 21457 mini_ranger.cc:66] Stopping Ranger...
I20260811 11:47:43.952260 21457 mini_ranger.cc:68] Stopped Ranger
2026-08-11 11:47:43.952 UTC [3440] LOG: received smart shutdown request
2026-08-11 11:47:43.957 UTC [3440] LOG: background worker "logical replication launcher" (PID 3453) exited with exit code 1
2026-08-11 11:47:43.957 UTC [3447] LOG: shutting down
2026-08-11 11:47:44.153 UTC [3440] LOG: database system is shut down
2026-08-11T11:47:44Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (50941 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:47:44 dist-test-slave-vkjp krb5kdc[5289](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:47:44 dist-test-slave-vkjp krb5kdc[5289](info): set up 2 sockets
Aug 11 11:47:44 dist-test-slave-vkjp krb5kdc[5289](info): commencing operation
krb5kdc: starting...
W20260811 11:47:45.422971 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:47:45 dist-test-slave-vkjp krb5kdc[5289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:47:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:47:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:47:45.560148 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:34463
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:45521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:34463,127.20.244.125:39435,127.20.244.124:45145
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:47:45.683326 5303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:45.683611 5303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:45.683655 5303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:45.687834 5303 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:47:45.687907 5303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:45.687927 5303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:45.687943 5303 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:47:45.687958 5303 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:47:45.693440 5303 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:45521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:34463,127.20.244.125:39435,127.20.244.124:45145
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:34463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5303
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:45.694587 5303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:45.695801 5303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:45.704629 5317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:45.704651 5315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:45.704651 5311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:45.705049 5303 server_base.cc:1034] running on GCE node
I20260811 11:47:45.705709 5303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:45.706935 5303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:45.708150 5303 hybrid_clock.cc:648] HybridClock initialized: now 1786448865708131 us; error 33 us; skew 500 ppm
Aug 11 11:47:45 dist-test-slave-vkjp krb5kdc[5289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448865, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:45.711486 5303 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:47:45.712445 5303 webserver.cc:460] Webserver started at http://127.20.244.126:45353/ using document root <none> and password file <none>
I20260811 11:47:45.712992 5303 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:45.713053 5303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:47:45.713243 5303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:47:45.715394 5303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "cd82a2112f134d66b8853e8e30c00071"
format_stamp: "Formatted at 2026-08-11 11:47:45 on dist-test-slave-vkjp"
server_key: "d747ec746ff641ac5f1ecb3af42d6d00"
server_key_iv: "5844c97b5f814b79e842492783ec4dae"
server_key_version: "encryptionkey@0"
I20260811 11:47:45.715924 5303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "cd82a2112f134d66b8853e8e30c00071"
format_stamp: "Formatted at 2026-08-11 11:47:45 on dist-test-slave-vkjp"
server_key: "d747ec746ff641ac5f1ecb3af42d6d00"
server_key_iv: "5844c97b5f814b79e842492783ec4dae"
server_key_version: "encryptionkey@0"
I20260811 11:47:45.719668 5303 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 11:47:45.722080 5325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:45.723392 5303 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:47:45.723531 5303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "cd82a2112f134d66b8853e8e30c00071"
format_stamp: "Formatted at 2026-08-11 11:47:45 on dist-test-slave-vkjp"
server_key: "d747ec746ff641ac5f1ecb3af42d6d00"
server_key_iv: "5844c97b5f814b79e842492783ec4dae"
server_key_version: "encryptionkey@0"
I20260811 11:47:45.723646 5303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:45.740058 5303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:45.743292 5303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:45.743518 5303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:45.751482 5303 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:34463
I20260811 11:47:45.751808 5386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:34463 every 8 connection(s)
I20260811 11:47:45.752591 5303 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:47:45.755568 5387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:47:45.758149 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 5303
I20260811 11:47:45.758307 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:47:45.758633 21457 external_mini_cluster.cc:1428] Setting key fd6dc65e45dc6b867534e110de07472a
I20260811 11:47:45.760143 5387 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.20.244.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.125@KRBTEST.COM" created.
Aug 11 11:47:45 dist-test-slave-vkjp krb5kdc[5289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448865, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:47:45.779785 5391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:45.763006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:34463 (local address 127.0.0.1:33310)
0811 11:47:45.763679 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:45.763718 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:45.764671 (+ 953us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:45.765403 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:45.765409 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:45.765887 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:45.766136 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:45.766151 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:45.767393 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:45.767398 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:45.768157 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:45.768166 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:45.768830 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:45.768834 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:45.768952 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:45.769583 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:45.769602 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:45.772823 (+ 3221us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:45.776307 (+ 3484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:45.776321 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:45.776336 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:45.776714 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:45.777107 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:45.777111 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:45.777114 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:45.777284 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:45.778002 (+ 718us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:45.778012 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:45.778216 (+ 204us) client_negotiation.cc:769] Sending connection context
0811 11:47:45.778457 (+ 241us) client_negotiation.cc:240] Negotiation successful
0811 11:47:45.778934 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"mutex_wait_us":82,"spinlock_wait_cycles":16640,"thread_start_us":196,"threads_started":1}
I20260811 11:47:45.779783 5390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:45.763006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33310 (local address 127.20.244.126:34463)
0811 11:47:45.763506 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:45.763526 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:45.763835 (+ 309us) server_negotiation.cc:407] Connection header received
0811 11:47:45.765000 (+ 1165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:45.765004 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:45.765188 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:45.765404 (+ 216us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:45.766294 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:45.767266 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:45.768285 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:45.768664 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:45.768842 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:45.773019 (+ 4177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:45.773026 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:45.773039 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:45.773065 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:45.776160 (+ 3095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:45.776863 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:45.776870 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:45.776872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:45.776992 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:45.777398 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:45.777401 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:45.777402 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:45.777864 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:45.777982 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:45.778546 (+ 564us) server_negotiation.cc:299] Negotiation successful
0811 11:47:45.778845 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":342,"thread_start_us":155,"threads_started":1}
I20260811 11:47:45.782418 5387 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:47:45.783311 5391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:45.783006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:39435 (local address 127.0.0.1:38992)
0811 11:47:45.783173 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:45.783244 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.125:39435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 11:47:45.783593 5329 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.244.125:39435: connect: Connection refused (error 111)
I20260811 11:47:45.784652 5391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:45.784384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:39435 (local address 127.0.0.1:39000)
0811 11:47:45.784522 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:45.784585 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.125:39435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 11:47:45.784906 5387 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.125:39435: Network error: Client connection negotiation failed: client connection to 127.20.244.125:39435: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.125.keytab.
Entry for principal kudu/127.20.244.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.125.keytab.
I20260811 11:47:45.791385 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.125:39435
--webserver_interface=127.20.244.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.125.keytab
--principal=kudu/127.20.244.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:45521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:34463,127.20.244.125:39435,127.20.244.124:45145
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:47:45.834193 5387 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } attempt: 1
I20260811 11:47:45.835242 5391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:45.834851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:39435 (local address 127.0.0.1:39006)
0811 11:47:45.835014 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:45.835124 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.125:39435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 11:47:45.836059 5391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:45.835840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:39435 (local address 127.0.0.1:39020)
0811 11:47:45.835948 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:45.836003 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.125:39435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 11:47:45.836196 5387 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.125:39435: Network error: Client connection negotiation failed: client connection to 127.20.244.125:39435: connect: Connection refused (error 111)
I20260811 11:47:45.904414 5387 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } attempt: 2
I20260811 11:47:45.905419 5391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:45.905104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:39435 (local address 127.0.0.1:39032)
0811 11:47:45.905263 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:45.905341 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.125:39435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 11:47:45.906162 5391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:45.905938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:39435 (local address 127.0.0.1:39036)
0811 11:47:45.906050 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:45.906106 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.125:39435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 11:47:45.906304 5387 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.125:39435: Network error: Client connection negotiation failed: client connection to 127.20.244.125:39435: connect: Connection refused (error 111)
W20260811 11:47:45.911983 5396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:45.912292 5396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:45.912397 5396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:45.916616 5396 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:47:45.916725 5396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:45.916777 5396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:45.916834 5396 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:47:45.916872 5396 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:47:45.922387 5396 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:45521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:34463,127.20.244.125:39435,127.20.244.124:45145
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.125.keytab
--principal=kudu/127.20.244.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.125:39435
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.244.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5396
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:45.923610 5396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:45.924649 5396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:45.933620 5404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:45.933698 5402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:45.933658 5401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:45.933861 5396 server_base.cc:1034] running on GCE node
I20260811 11:47:45.934455 5396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:45.935873 5396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:45.937147 5396 hybrid_clock.cc:648] HybridClock initialized: now 1786448865937129 us; error 36 us; skew 500 ppm
Aug 11 11:47:45 dist-test-slave-vkjp krb5kdc[5289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448865, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:45.940321 5396 init.cc:377] Logged in from keytab as kudu/127.20.244.125@KRBTEST.COM (short username kudu)
I20260811 11:47:45.941349 5396 webserver.cc:460] Webserver started at http://127.20.244.125:36243/ using document root <none> and password file <none>
I20260811 11:47:45.942010 5396 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:45.942103 5396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:47:45.942355 5396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:47:45.944635 5396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-1/data/instance:
uuid: "308286d5215e42a39fadacac6f059b9a"
format_stamp: "Formatted at 2026-08-11 11:47:45 on dist-test-slave-vkjp"
server_key: "7b7cb3368f8f7b5e834734b87a797418"
server_key_iv: "9138ebfe84facffc66310c69f3b36c7d"
server_key_version: "encryptionkey@0"
I20260811 11:47:45.945394 5396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-1/wal/instance:
uuid: "308286d5215e42a39fadacac6f059b9a"
format_stamp: "Formatted at 2026-08-11 11:47:45 on dist-test-slave-vkjp"
server_key: "7b7cb3368f8f7b5e834734b87a797418"
server_key_iv: "9138ebfe84facffc66310c69f3b36c7d"
server_key_version: "encryptionkey@0"
I20260811 11:47:45.949617 5396 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260811 11:47:45.952396 5411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:45.953753 5396 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 11:47:45.953953 5396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-1/wal
uuid: "308286d5215e42a39fadacac6f059b9a"
format_stamp: "Formatted at 2026-08-11 11:47:45 on dist-test-slave-vkjp"
server_key: "7b7cb3368f8f7b5e834734b87a797418"
server_key_iv: "9138ebfe84facffc66310c69f3b36c7d"
server_key_version: "encryptionkey@0"
I20260811 11:47:45.954094 5396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:45.980177 5396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:45.983753 5396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:45.983987 5396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:45.991524 5396 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.125:39435
I20260811 11:47:45.991814 5481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.125:39435 every 8 connection(s)
I20260811 11:47:45.992614 5396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-1/data/info.pb
I20260811 11:47:45.995553 5482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:47:45.997489 5387 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } attempt: 3
I20260811 11:47:45.999765 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 5396
I20260811 11:47:45.999902 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-1/wal/instance
I20260811 11:47:46.000248 21457 external_mini_cluster.cc:1428] Setting key 5156991ca5a55174a96d1e9250535e32
I20260811 11:47:46.000005 5482 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 11:47:46 dist-test-slave-vkjp krb5kdc[5289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448865, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for kudu/127.20.244.125@KRBTEST.COM
Aug 11 11:47:46 dist-test-slave-vkjp krb5kdc[5289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448865, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.125@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.244.124@KRBTEST.COM; defaulting to no policy
I20260811 11:47:46.012836 5391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:45.998093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:39435 (local address 127.0.0.1:39044)
0811 11:47:45.998276 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:45.998296 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:45.998398 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:46.001147 (+ 2749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:46.001151 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:46.001390 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:46.001549 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:46.001558 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.003442 (+ 1884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.003448 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:46.004365 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:46.004376 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.005162 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.005168 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:46.005321 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:46.005973 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:46.005995 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:46.007869 (+ 1874us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:46.010541 (+ 2672us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:46.010546 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:46.010549 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:46.010839 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:46.011305 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:46.011309 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:46.011314 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:46.011432 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:46.012212 (+ 780us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:46.012214 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:46.012340 (+ 126us) client_negotiation.cc:769] Sending connection context
0811 11:47:46.012474 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 11:47:46.012637 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71,"mutex_wait_us":1}
I20260811 11:47:46.014010 5390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.002308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33318 (local address 127.20.244.126:34463)
0811 11:47:46.002439 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:46.002446 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:46.002892 (+ 446us) server_negotiation.cc:407] Connection header received
0811 11:47:46.003119 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:46.003122 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:46.003180 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:46.003234 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:46.004080 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.004937 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.006267 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.006523 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.006646 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:46.009637 (+ 2991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:46.009644 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:46.009647 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:46.009675 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:46.012062 (+ 2387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.012667 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.012671 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.012673 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.012757 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.013056 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.013062 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.013066 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.013289 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:46.013395 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:46.013789 (+ 394us) server_negotiation.cc:299] Negotiation successful
0811 11:47:46.013896 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":53}
I20260811 11:47:46.014173 5487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.002293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:34463 (local address 127.0.0.1:33318)
0811 11:47:46.002761 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:46.002812 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:46.002995 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:46.003433 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:46.003438 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:46.003807 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:46.003943 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:46.003949 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.005079 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.005083 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:46.006133 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:46.006143 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.006690 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.006694 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:46.006823 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:46.007461 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:46.007490 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:46.009436 (+ 1946us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:46.012181 (+ 2745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:46.012192 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:46.012200 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:46.012556 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:46.012857 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:46.012861 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:46.012863 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:46.012951 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:46.013415 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:46.013422 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:46.013550 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 11:47:46.013704 (+ 154us) client_negotiation.cc:240] Negotiation successful
0811 11:47:46.013895 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":63,"thread_start_us":172,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.124@KRBTEST.COM" created.
I20260811 11:47:46.014173 5484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:45.998822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39044 (local address 127.20.244.125:39435)
0811 11:47:45.999273 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:45.999289 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:45.999326 (+ 37us) server_negotiation.cc:407] Connection header received
0811 11:47:46.000274 (+ 948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:46.000302 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:46.000774 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:46.001178 (+ 404us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:46.001679 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.003289 (+ 1610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.004492 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.005025 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.005209 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:46.008055 (+ 2846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:46.008066 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:46.008085 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:46.008120 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:46.010394 (+ 2274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.010972 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.010981 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.010991 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.011178 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.011575 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.011580 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.011584 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.012087 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:46.012254 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:46.012666 (+ 412us) server_negotiation.cc:299] Negotiation successful
0811 11:47:46.013021 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":302,"thread_start_us":145,"threads_started":1}
I20260811 11:47:46.016389 5387 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:47:46.016836 5482 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:47:46.017266 5391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.016935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:45145 (local address 127.0.0.1:35104)
0811 11:47:46.017123 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:46.017183 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:45145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260811 11:47:46.018157 5391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.017856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:45145 (local address 127.0.0.1:35108)
0811 11:47:46.018023 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:46.018083 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:45145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
W20260811 11:47:46.018363 5387 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.124:45145: Network error: Client connection negotiation failed: client connection to 127.20.244.124:45145: connect: Connection refused (error 111)
Aug 11 11:47:46 dist-test-slave-vkjp krb5kdc[5289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448865, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.125@KRBTEST.COM for kudu/127.20.244.125@KRBTEST.COM
I20260811 11:47:46.025748 5487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.017373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:39435 (local address 127.0.0.1:39048)
0811 11:47:46.017465 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:46.017479 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:46.017580 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:46.017849 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:46.017852 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:46.018042 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:46.018131 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:46.018137 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.018953 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.018958 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:46.019549 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:46.019557 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.020040 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.020043 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:46.020123 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:46.020619 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:46.020633 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:46.022230 (+ 1597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:46.024278 (+ 2048us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:46.024280 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:46.024282 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:46.024481 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:46.024791 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:46.024793 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:46.024794 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:46.024875 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:46.025248 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:46.025250 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:46.025333 (+ 83us) client_negotiation.cc:769] Sending connection context
0811 11:47:46.025425 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 11:47:46.025532 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 11:47:46.025770 5484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.017423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39048 (local address 127.20.244.125:39435)
0811 11:47:46.017526 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:46.017530 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:46.017546 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:47:46.017673 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:46.017679 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:46.017731 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:46.017820 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:46.018247 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.018841 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.019669 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.019922 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.020039 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:46.022384 (+ 2345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:46.022388 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:46.022391 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:46.022423 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:46.024152 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.024593 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.024599 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.024601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.024689 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.024973 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.024976 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.024978 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.025163 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:46.025242 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:46.025520 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 11:47:46.025643 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 11:47:46.026659 5482 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:47:46.027555 5487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.027222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:45145 (local address 127.0.0.1:35120)
0811 11:47:46.027357 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:46.027467 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:45145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 11:47:46.027976 5412 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.244.124:45145: connect: Connection refused (error 111)
I20260811 11:47:46.028978 5487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.028754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:45145 (local address 127.0.0.1:35132)
0811 11:47:46.028875 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:46.028929 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:45145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 11:47:46.029150 5482 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.124:45145: Network error: Client connection negotiation failed: client connection to 127.20.244.124:45145: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.124.keytab.
Entry for principal kudu/127.20.244.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.124.keytab.
I20260811 11:47:46.034914 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.124:45145
--webserver_interface=127.20.244.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.124.keytab
--principal=kudu/127.20.244.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:45521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:34463,127.20.244.125:39435,127.20.244.124:45145
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:47:46.049533 5387 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } attempt: 1
I20260811 11:47:46.050414 5391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.050082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:45145 (local address 127.0.0.1:35136)
0811 11:47:46.050251 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:46.050323 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:45145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 11:47:46.051236 5391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.050983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:45145 (local address 127.0.0.1:35146)
0811 11:47:46.051122 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:46.051176 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:45145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 11:47:46.051367 5387 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.124:45145: Network error: Client connection negotiation failed: client connection to 127.20.244.124:45145: connect: Connection refused (error 111)
I20260811 11:47:46.078426 5482 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } attempt: 1
I20260811 11:47:46.079411 5487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.079051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:45145 (local address 127.0.0.1:35162)
0811 11:47:46.079258 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:46.079330 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:45145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260811 11:47:46.080272 5487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.080019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:45145 (local address 127.0.0.1:35172)
0811 11:47:46.080154 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:46.080211 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:45145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 11:47:46.080442 5482 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.124:45145: Network error: Client connection negotiation failed: client connection to 127.20.244.124:45145: connect: Connection refused (error 111)
I20260811 11:47:46.126561 5387 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } attempt: 2
I20260811 11:47:46.127489 5391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.127183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:45145 (local address 127.0.0.1:35178)
0811 11:47:46.127325 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:46.127404 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:45145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 11:47:46.128335 5391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.128089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:45145 (local address 127.0.0.1:35190)
0811 11:47:46.128220 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:46.128278 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:45145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 11:47:46.128509 5387 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.124:45145: Network error: Client connection negotiation failed: client connection to 127.20.244.124:45145: connect: Connection refused (error 111)
I20260811 11:47:46.148633 5482 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } attempt: 2
I20260811 11:47:46.149533 5487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.149216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:45145 (local address 127.0.0.1:35206)
0811 11:47:46.149380 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:46.149450 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:45145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 11:47:46.150312 5487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.150105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:45145 (local address 127.0.0.1:35214)
0811 11:47:46.150216 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:46.150261 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:45145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 11:47:46.150496 5482 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.124:45145: Network error: Client connection negotiation failed: client connection to 127.20.244.124:45145: connect: Connection refused (error 111)
W20260811 11:47:46.152904 5490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:46.153175 5490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:46.153266 5490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:46.157367 5490 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:47:46.157441 5490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:46.157462 5490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:46.157480 5490 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:47:46.157534 5490 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:47:46.163038 5490 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:45521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:34463,127.20.244.125:39435,127.20.244.124:45145
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.124.keytab
--principal=kudu/127.20.244.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.124:45145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.244.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:46.164216 5490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:46.165258 5490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:46.174081 5498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:46.174088 5496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:46.174105 5495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:46.174428 5490 server_base.cc:1034] running on GCE node
I20260811 11:47:46.175060 5490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:46.176285 5490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:46.177488 5490 hybrid_clock.cc:648] HybridClock initialized: now 1786448866177477 us; error 34 us; skew 500 ppm
Aug 11 11:47:46 dist-test-slave-vkjp krb5kdc[5289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448866, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:46.180449 5490 init.cc:377] Logged in from keytab as kudu/127.20.244.124@KRBTEST.COM (short username kudu)
I20260811 11:47:46.181360 5490 webserver.cc:460] Webserver started at http://127.20.244.124:35891/ using document root <none> and password file <none>
I20260811 11:47:46.181932 5490 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:46.181994 5490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:47:46.182173 5490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:47:46.184315 5490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-2/data/instance:
uuid: "65ccec6b135f4b9b85a80adaccb9f49c"
format_stamp: "Formatted at 2026-08-11 11:47:46 on dist-test-slave-vkjp"
server_key: "d939cf3294b3ca3972714570804ddc25"
server_key_iv: "58fe767d893d9ea1f06a91123600cb90"
server_key_version: "encryptionkey@0"
I20260811 11:47:46.184862 5490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-2/wal/instance:
uuid: "65ccec6b135f4b9b85a80adaccb9f49c"
format_stamp: "Formatted at 2026-08-11 11:47:46 on dist-test-slave-vkjp"
server_key: "d939cf3294b3ca3972714570804ddc25"
server_key_iv: "58fe767d893d9ea1f06a91123600cb90"
server_key_version: "encryptionkey@0"
I20260811 11:47:46.189185 5490 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 11:47:46.191875 5505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:46.193276 5490 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:47:46.193408 5490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-2/wal
uuid: "65ccec6b135f4b9b85a80adaccb9f49c"
format_stamp: "Formatted at 2026-08-11 11:47:46 on dist-test-slave-vkjp"
server_key: "d939cf3294b3ca3972714570804ddc25"
server_key_iv: "58fe767d893d9ea1f06a91123600cb90"
server_key_version: "encryptionkey@0"
I20260811 11:47:46.193540 5490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:46.207754 5490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:46.211135 5490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:46.211354 5490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:46.218858 5490 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.124:45145
I20260811 11:47:46.219182 5569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.124:45145 every 8 connection(s)
I20260811 11:47:46.220063 5490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-2/data/info.pb
I20260811 11:47:46.222622 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 5490
I20260811 11:47:46.222806 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786448696706302-21457-0/minicluster-data/master-2/wal/instance
I20260811 11:47:46.223205 21457 external_mini_cluster.cc:1428] Setting key f313e518be99e013585b6f5aaa67f60f
I20260811 11:47:46.223346 5570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:47:46.227674 5387 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } attempt: 3
I20260811 11:47:46.229053 5570 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 11:47:46 dist-test-slave-vkjp krb5kdc[5289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448865, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for kudu/127.20.244.124@KRBTEST.COM
Aug 11 11:47:46 dist-test-slave-vkjp krb5kdc[5289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.124@KRBTEST.COM
Aug 11 11:47:46 dist-test-slave-vkjp krb5kdc[5289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448866, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.124@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:47:46.240540 5391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.228233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:45145 (local address 127.0.0.1:35230)
0811 11:47:46.228380 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:46.228398 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:46.228512 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:46.228997 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:46.229000 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:46.229193 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:46.229296 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:46.229303 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.230333 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.230337 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:46.231153 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:46.231164 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.232025 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.232029 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:46.232126 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:46.232714 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:46.232729 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:46.234410 (+ 1681us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:46.237169 (+ 2759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:46.237172 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:46.237175 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:46.237444 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:46.237809 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:46.237812 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:46.237814 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:46.237944 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:46.239902 (+ 1958us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:46.239905 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:46.240018 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 11:47:46.240186 (+ 168us) client_negotiation.cc:240] Negotiation successful
0811 11:47:46.240345 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 11:47:46.241238 5390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.231026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33320 (local address 127.20.244.126:34463)
0811 11:47:46.231189 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:46.231193 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:46.231595 (+ 402us) server_negotiation.cc:407] Connection header received
0811 11:47:46.231741 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:46.231744 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:46.231795 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:46.231837 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:46.232845 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.233517 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.234430 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.234823 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.234958 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:46.237541 (+ 2583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:46.237578 (+ 37us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:46.237583 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:46.237616 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:46.239327 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.239847 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.239851 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.239852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.239938 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.240216 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.240222 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.240226 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.240443 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:46.240573 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:46.240948 (+ 375us) server_negotiation.cc:299] Negotiation successful
0811 11:47:46.241076 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 11:47:46.241649 5482 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } attempt: 3
I20260811 11:47:46.242141 5574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.228287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35230 (local address 127.20.244.124:45145)
0811 11:47:46.228742 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:46.228751 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:46.228776 (+ 25us) server_negotiation.cc:407] Connection header received
0811 11:47:46.228810 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:46.228813 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:46.228851 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:46.228939 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:46.229432 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.230201 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.231278 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.231896 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.232092 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:46.234587 (+ 2495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:46.234593 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:46.234605 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:46.234640 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:46.237032 (+ 2392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.237558 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.237564 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.237571 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.237705 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.238086 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.238092 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.238097 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.239768 (+ 1671us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:46.239937 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:46.241318 (+ 1381us) server_negotiation.cc:299] Negotiation successful
0811 11:47:46.241576 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":102,"server-negotiator.queue_time_us":388,"thread_start_us":183,"threads_started":1}
I20260811 11:47:46.242157 5573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.224797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35226 (local address 127.20.244.124:45145)
0811 11:47:46.225270 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:46.225290 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:46.225335 (+ 45us) server_negotiation.cc:407] Connection header received
0811 11:47:46.226408 (+ 1073us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:46.226435 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:46.226903 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:46.227405 (+ 502us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:46.228594 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.229881 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.231017 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.231896 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.232449 (+ 553us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:46.235890 (+ 3441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:46.235895 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:46.235899 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:46.235935 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:46.238959 (+ 3024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.239520 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.239524 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.239526 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.239612 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.239955 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.239961 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.239966 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.240188 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:46.240375 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:46.240691 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 11:47:46.241056 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":463,"server-negotiator.queue_time_us":318,"thread_start_us":133,"threads_started":1}
I20260811 11:47:46.242877 5575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.231001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:34463 (local address 127.0.0.1:33320)
0811 11:47:46.231452 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:46.231504 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:46.231625 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:46.232018 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:46.232023 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:46.232494 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:46.232698 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:46.232708 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.233634 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.233636 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:46.234306 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:46.234315 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.234982 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.234987 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:46.235157 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:46.235704 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:46.235719 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:46.237365 (+ 1646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:46.239448 (+ 2083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:46.239454 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:46.239460 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:46.239726 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:46.240015 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:46.240018 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:46.240019 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:46.240110 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:46.240621 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:46.240628 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:46.240734 (+ 106us) client_negotiation.cc:769] Sending connection context
0811 11:47:46.240878 (+ 144us) client_negotiation.cc:240] Negotiation successful
0811 11:47:46.241113 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"mutex_wait_us":73,"thread_start_us":132,"threads_started":1}
I20260811 11:47:46.244619 5570 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:47:46.247229 5387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071: Bootstrap starting.
Aug 11 11:47:46 dist-test-slave-vkjp krb5kdc[5289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448865, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.125@KRBTEST.COM for kudu/127.20.244.124@KRBTEST.COM
I20260811 11:47:46.250393 5387 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071: Neither blocks nor log segments found. Creating new log.
Aug 11 11:47:46 dist-test-slave-vkjp krb5kdc[5289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448866, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.124@KRBTEST.COM for kudu/127.20.244.125@KRBTEST.COM
Aug 11 11:47:46 dist-test-slave-vkjp krb5kdc[5289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:47:46.251698 5387 log.cc:824] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071: Log is configured to *not* fsync() on all Append() calls
I20260811 11:47:46.254865 5387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071: No bootstrap required, opened a new log
I20260811 11:47:46.254981 5487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.242099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:45145 (local address 127.0.0.1:35244)
0811 11:47:46.242378 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:46.242395 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:46.242491 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:46.243224 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:46.243230 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:46.243431 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:46.243544 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:46.243552 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.246624 (+ 3072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.246628 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:46.247440 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:46.247452 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.248066 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.248070 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:46.248153 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:46.248723 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:46.248753 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:46.250427 (+ 1674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:46.253032 (+ 2605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:46.253035 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:46.253037 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:46.253370 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:46.253715 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:46.253719 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:46.253722 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:46.253829 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:46.254355 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:46.254358 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:46.254465 (+ 107us) client_negotiation.cc:769] Sending connection context
0811 11:47:46.254641 (+ 176us) client_negotiation.cc:240] Negotiation successful
0811 11:47:46.254792 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196}
I20260811 11:47:46.255744 5484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.245574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39058 (local address 127.20.244.125:39435)
0811 11:47:46.245688 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:46.245692 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:46.245705 (+ 13us) server_negotiation.cc:407] Connection header received
0811 11:47:46.245790 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:46.245792 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:46.245830 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:46.245920 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:46.246316 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.247040 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.248175 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.248820 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.248887 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:46.251654 (+ 2767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:46.251658 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:46.251661 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:46.251688 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:46.253695 (+ 2007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.254244 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.254249 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.254251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.254337 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.254674 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.254680 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.254684 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.254909 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:46.255004 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:46.255441 (+ 437us) server_negotiation.cc:299] Negotiation successful
0811 11:47:46.255570 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 11:47:46.256218 5577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.242620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35244 (local address 127.20.244.124:45145)
0811 11:47:46.242940 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:46.242948 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:46.242961 (+ 13us) server_negotiation.cc:407] Connection header received
0811 11:47:46.242993 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:46.242995 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:46.243036 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:46.243981 (+ 945us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:46.244104 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.245459 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.247593 (+ 2134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.247930 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.248415 (+ 485us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:46.250592 (+ 2177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:46.250598 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:46.250602 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:46.250633 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:46.252865 (+ 2232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.253483 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.253487 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.253489 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.253580 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.253967 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.253972 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.253977 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.254214 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:46.255600 (+ 1386us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:46.255685 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 11:47:46.256045 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":133,"threads_started":1}
I20260811 11:47:46.256342 5575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.245325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:39435 (local address 127.0.0.1:39058)
0811 11:47:46.245625 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:46.245639 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:46.245703 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:46.245935 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:46.245938 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:46.246113 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:46.246199 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:46.246204 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.247204 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.247207 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:46.248035 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:46.248046 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.249047 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.249051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:46.249147 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:46.249874 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:46.249889 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:46.251483 (+ 1594us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:46.253831 (+ 2348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:46.253834 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:46.253836 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:46.254110 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:46.254464 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:46.254468 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:46.254469 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:46.254559 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:46.255114 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:46.255119 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:46.255219 (+ 100us) client_negotiation.cc:769] Sending connection context
0811 11:47:46.255956 (+ 737us) client_negotiation.cc:240] Negotiation successful
0811 11:47:46.256112 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230}
I20260811 11:47:46.257061 5390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.245113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33328 (local address 127.20.244.126:34463)
0811 11:47:46.245218 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:46.245223 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:46.245414 (+ 191us) server_negotiation.cc:407] Connection header received
0811 11:47:46.245581 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:46.245584 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:46.245630 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:46.245702 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:46.246584 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.247301 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.248363 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.248737 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.248834 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:46.252487 (+ 3653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:46.252492 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:46.252496 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:46.252524 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:46.254640 (+ 2116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.255184 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.255187 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.255188 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.255275 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.255637 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.255640 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.255642 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.255887 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:46.256641 (+ 754us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:46.256742 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 11:47:46.256891 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 11:47:46.259205 5570 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:47:46.259492 5387 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd82a2112f134d66b8853e8e30c00071" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 } } peers { permanent_uuid: "308286d5215e42a39fadacac6f059b9a" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } } peers { permanent_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } }
I20260811 11:47:46.259861 5387 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:47:46.259964 5387 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd82a2112f134d66b8853e8e30c00071, State: Initialized, Role: FOLLOWER
I20260811 11:47:46.260509 5482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a: Bootstrap starting.
I20260811 11:47:46.260514 5387 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd82a2112f134d66b8853e8e30c00071" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 } } peers { permanent_uuid: "308286d5215e42a39fadacac6f059b9a" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } } peers { permanent_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } }
I20260811 11:47:46.262056 5387 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:47:46.263746 5482 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a: Neither blocks nor log segments found. Creating new log.
Aug 11 11:47:46 dist-test-slave-vkjp krb5kdc[5289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.125@KRBTEST.COM
I20260811 11:47:46.264844 5482 log.cc:824] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a: Log is configured to *not* fsync() on all Append() calls
Aug 11 11:47:46 dist-test-slave-vkjp krb5kdc[5289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448866, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.124@KRBTEST.COM for kudu/127.20.244.124@KRBTEST.COM
I20260811 11:47:46.267525 5482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a: No bootstrap required, opened a new log
I20260811 11:47:46.269640 5575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.259729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:45145 (local address 127.0.0.1:35252)
0811 11:47:46.260048 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:46.260062 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:46.260129 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:46.261112 (+ 983us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:46.261115 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:46.261298 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:46.261375 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:46.261380 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.262337 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.262339 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:46.263147 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:46.263160 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.263967 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.263970 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:46.264081 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:46.264549 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:46.264564 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:46.266107 (+ 1543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:46.268087 (+ 1980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:46.268090 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:46.268092 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:46.268336 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:46.268607 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:46.268610 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:46.268612 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:46.268691 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:46.269128 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:46.269130 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:46.269210 (+ 80us) client_negotiation.cc:769] Sending connection context
0811 11:47:46.269315 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 11:47:46.269458 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247}
I20260811 11:47:46.269793 5484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.258616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39062 (local address 127.20.244.125:39435)
0811 11:47:46.258963 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:46.258966 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:46.258978 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:47:46.259005 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:46.259007 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:46.259040 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:46.259155 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:46.260021 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.260632 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.261707 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.262054 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.262143 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:46.265556 (+ 3413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:46.265561 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:46.265564 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:46.265592 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:46.267325 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.267880 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.267885 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.267890 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.267994 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.268321 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.268325 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.268327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.268585 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:46.268792 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:46.269538 (+ 746us) server_negotiation.cc:299] Negotiation successful
0811 11:47:46.269654 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282}
I20260811 11:47:46.270175 5574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.259936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35252 (local address 127.20.244.124:45145)
0811 11:47:46.260826 (+ 890us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:46.260830 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:46.260841 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:47:46.260873 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:46.260875 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:46.260928 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:46.261016 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:46.261490 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.262226 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.263282 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.263732 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.263822 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:46.266255 (+ 2433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:46.266259 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:46.266262 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:46.266289 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:46.267970 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.268432 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.268435 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.268436 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.268516 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.268789 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.268792 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.268793 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.268998 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:46.269094 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:46.269961 (+ 867us) server_negotiation.cc:299] Negotiation successful
0811 11:47:46.270080 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":814}
I20260811 11:47:46.272893 5570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c: Bootstrap starting.
I20260811 11:47:46.272789 5482 raft_consensus.cc:348] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd82a2112f134d66b8853e8e30c00071" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 } } peers { permanent_uuid: "308286d5215e42a39fadacac6f059b9a" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } } peers { permanent_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } }
I20260811 11:47:46.273021 5482 raft_consensus.cc:374] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:47:46.273135 5482 raft_consensus.cc:729] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308286d5215e42a39fadacac6f059b9a, State: Initialized, Role: FOLLOWER
I20260811 11:47:46.269408 5303 master_runner.cc:186] Error getting master registration for 127.20.244.125:39435: OK, instance_id { permanent_uuid: "308286d5215e42a39fadacac6f059b9a" instance_seqno: 1786448865989390 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 11:47:46.273732 5303 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 11:47:46.273747 5482 consensus_queue.cc:260] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd82a2112f134d66b8853e8e30c00071" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 } } peers { permanent_uuid: "308286d5215e42a39fadacac6f059b9a" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } } peers { permanent_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } }
I20260811 11:47:46.274348 5596 sys_catalog.cc:455] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd82a2112f134d66b8853e8e30c00071" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 } } peers { permanent_uuid: "308286d5215e42a39fadacac6f059b9a" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } } peers { permanent_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } } }
I20260811 11:47:46.274552 5596 sys_catalog.cc:458] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:47:46.275293 5482 sys_catalog.cc:564] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:47:46.275853 5570 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c: Neither blocks nor log segments found. Creating new log.
I20260811 11:47:46.276819 5570 log.cc:824] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c: Log is configured to *not* fsync() on all Append() calls
I20260811 11:47:46.277240 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 11:47:46.280611 5594 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:47:46.280611 5614 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:47:46.280689 5614 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260811 11:47:46.280798 5594 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:47:46.281544 5570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c: No bootstrap required, opened a new log
I20260811 11:47:46.281502 5579 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd82a2112f134d66b8853e8e30c00071" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 } } peers { permanent_uuid: "308286d5215e42a39fadacac6f059b9a" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } } peers { permanent_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } } }
I20260811 11:47:46.281728 5579 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:47:46.282763 5396 master_runner.cc:186] Error getting master registration for 127.20.244.124:45145: OK, instance_id { permanent_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" instance_seqno: 1786448866216673 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 11:47:46.286269 5396 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 11:47:46.286475 5570 raft_consensus.cc:348] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd82a2112f134d66b8853e8e30c00071" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 } } peers { permanent_uuid: "308286d5215e42a39fadacac6f059b9a" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } } peers { permanent_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } }
I20260811 11:47:46.286729 5570 raft_consensus.cc:374] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:47:46.286784 5570 raft_consensus.cc:729] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ccec6b135f4b9b85a80adaccb9f49c, State: Initialized, Role: FOLLOWER
I20260811 11:47:46.287322 5570 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd82a2112f134d66b8853e8e30c00071" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 } } peers { permanent_uuid: "308286d5215e42a39fadacac6f059b9a" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } } peers { permanent_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } }
I20260811 11:47:46.288790 5570 sys_catalog.cc:564] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:47:46.292011 5625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd82a2112f134d66b8853e8e30c00071" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 } } peers { permanent_uuid: "308286d5215e42a39fadacac6f059b9a" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } } peers { permanent_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } } }
I20260811 11:47:46.292269 5625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [sys.catalog]: This master's current role is: FOLLOWER
W20260811 11:47:46.295879 5641 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:47:46.296416 5641 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:47:46.297230 5490 master_runner.cc:263] No leader master found from master 65ccec6b135f4b9b85a80adaccb9f49c
I20260811 11:47:46.297307 5490 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 11:47:46.302222 5390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.282153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33338 (local address 127.20.244.126:34463)
0811 11:47:46.282281 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:46.282286 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:46.287508 (+ 5222us) server_negotiation.cc:407] Connection header received
0811 11:47:46.287789 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:46.287792 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:46.287842 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:46.287892 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:46.288985 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.289811 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.291331 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.291662 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.291755 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:46.298298 (+ 6543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:46.298302 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:46.298304 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:46.298337 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:46.300127 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.300733 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.300739 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.300744 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.300838 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.301191 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.301194 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.301196 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.301424 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:46.301557 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:46.301909 (+ 352us) server_negotiation.cc:299] Negotiation successful
0811 11:47:46.302052 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 11:47:46.302591 5574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.286652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35262 (local address 127.20.244.124:45145)
0811 11:47:46.286773 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:46.286778 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:46.291997 (+ 5219us) server_negotiation.cc:407] Connection header received
0811 11:47:46.292193 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:46.292197 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:46.292247 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:46.292320 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:46.293332 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.294062 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.295192 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.295508 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.295589 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:46.298444 (+ 2855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:46.298451 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:46.298454 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:46.298477 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:46.300243 (+ 1766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.300785 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.300792 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.300795 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.300877 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.301197 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.301202 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.301203 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.301424 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:46.301554 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:46.302195 (+ 641us) server_negotiation.cc:299] Negotiation successful
0811 11:47:46.302395 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 11:47:46.306713 5484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:46.291443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39078 (local address 127.20.244.125:39435)
0811 11:47:46.291565 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:46.291569 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:46.295351 (+ 3782us) server_negotiation.cc:407] Connection header received
0811 11:47:46.295523 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:46.295526 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:46.295569 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:46.295618 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:46.296619 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.297386 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.298530 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:46.298886 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:46.298976 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:46.303411 (+ 4435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:46.303415 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:46.303418 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:46.303445 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:46.304991 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.305426 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.305430 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.305432 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.305524 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:46.305806 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:46.305809 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:46.305811 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:46.306007 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:46.306157 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:46.306408 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 11:47:46.306528 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 11:47:46.383335 5625 raft_consensus.cc:482] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:47:46.383571 5625 raft_consensus.cc:504] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd82a2112f134d66b8853e8e30c00071" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 } } peers { permanent_uuid: "308286d5215e42a39fadacac6f059b9a" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } } peers { permanent_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } }
I20260811 11:47:46.384764 5625 leader_election.cc:288] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd82a2112f134d66b8853e8e30c00071 (127.20.244.126:34463), 308286d5215e42a39fadacac6f059b9a (127.20.244.125:39435)
I20260811 11:47:46.385756 5356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82a2112f134d66b8853e8e30c00071" is_pre_election: true
I20260811 11:47:46.386137 5356 raft_consensus.cc:2454] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ccec6b135f4b9b85a80adaccb9f49c in term 0.
I20260811 11:47:46.386767 5507 leader_election.cc:302] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ccec6b135f4b9b85a80adaccb9f49c, cd82a2112f134d66b8853e8e30c00071; no voters:
I20260811 11:47:46.387208 5625 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:47:46.387307 5625 raft_consensus.cc:482] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:47:46.387352 5625 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:47:46.388726 5625 raft_consensus.cc:504] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd82a2112f134d66b8853e8e30c00071" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 } } peers { permanent_uuid: "308286d5215e42a39fadacac6f059b9a" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } } peers { permanent_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } }
I20260811 11:47:46.389098 5625 leader_election.cc:288] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [CANDIDATE]: Term 1 election: Requested vote from peers cd82a2112f134d66b8853e8e30c00071 (127.20.244.126:34463), 308286d5215e42a39fadacac6f059b9a (127.20.244.125:39435)
I20260811 11:47:46.389699 5356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82a2112f134d66b8853e8e30c00071"
I20260811 11:47:46.389839 5356 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:47:46.391851 5356 raft_consensus.cc:2454] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ccec6b135f4b9b85a80adaccb9f49c in term 1.
I20260811 11:47:46.392311 5507 leader_election.cc:302] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ccec6b135f4b9b85a80adaccb9f49c, cd82a2112f134d66b8853e8e30c00071; no voters:
I20260811 11:47:46.393349 5443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308286d5215e42a39fadacac6f059b9a" is_pre_election: true
I20260811 11:47:46.393700 5443 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ccec6b135f4b9b85a80adaccb9f49c in term 0.
I20260811 11:47:46.394493 5441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308286d5215e42a39fadacac6f059b9a"
I20260811 11:47:46.394613 5441 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:47:46.396004 5441 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ccec6b135f4b9b85a80adaccb9f49c in term 1.
I20260811 11:47:46.396963 5625 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:47:46.397281 5625 raft_consensus.cc:686] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [term 1 LEADER]: Becoming Leader. State: Replica: 65ccec6b135f4b9b85a80adaccb9f49c, State: Running, Role: LEADER
I20260811 11:47:46.397754 5625 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd82a2112f134d66b8853e8e30c00071" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 } } peers { permanent_uuid: "308286d5215e42a39fadacac6f059b9a" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } } peers { permanent_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } }
I20260811 11:47:46.403911 5625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65ccec6b135f4b9b85a80adaccb9f49c. Latest consensus state: current_term: 1 leader_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd82a2112f134d66b8853e8e30c00071" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 } } peers { permanent_uuid: "308286d5215e42a39fadacac6f059b9a" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } } peers { permanent_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } } }
I20260811 11:47:46.405167 5625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [sys.catalog]: This master's current role is: LEADER
I20260811 11:47:46.407227 5647 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:47:46.408278 5647 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:47:46.414175 5441 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a [term 1 FOLLOWER]: Refusing update from remote peer 65ccec6b135f4b9b85a80adaccb9f49c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:47:46.415048 5644 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [LEADER]: Connected to new peer: Peer: permanent_uuid: "308286d5215e42a39fadacac6f059b9a" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:47:46.423631 5596 sys_catalog.cc:455] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65ccec6b135f4b9b85a80adaccb9f49c. Latest consensus state: current_term: 1 leader_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd82a2112f134d66b8853e8e30c00071" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 } } peers { permanent_uuid: "308286d5215e42a39fadacac6f059b9a" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } } peers { permanent_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } } }
I20260811 11:47:46.423785 5596 sys_catalog.cc:458] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:47:46.425231 5356 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071 [term 1 FOLLOWER]: Refusing update from remote peer 65ccec6b135f4b9b85a80adaccb9f49c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:47:46.426173 5644 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd82a2112f134d66b8853e8e30c00071" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:47:46.431061 5579 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65ccec6b135f4b9b85a80adaccb9f49c. Latest consensus state: current_term: 1 leader_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd82a2112f134d66b8853e8e30c00071" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 } } peers { permanent_uuid: "308286d5215e42a39fadacac6f059b9a" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } } peers { permanent_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } } }
I20260811 11:47:46.431239 5579 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:47:46.437420 5644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd82a2112f134d66b8853e8e30c00071" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 } } peers { permanent_uuid: "308286d5215e42a39fadacac6f059b9a" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } } peers { permanent_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } } }
I20260811 11:47:46.437587 5644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [sys.catalog]: This master's current role is: LEADER
I20260811 11:47:46.440845 5625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd82a2112f134d66b8853e8e30c00071" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 } } peers { permanent_uuid: "308286d5215e42a39fadacac6f059b9a" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } } peers { permanent_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } } }
I20260811 11:47:46.441020 5625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c [sys.catalog]: This master's current role is: LEADER
I20260811 11:47:46.443439 5596 sys_catalog.cc:455] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd82a2112f134d66b8853e8e30c00071" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 } } peers { permanent_uuid: "308286d5215e42a39fadacac6f059b9a" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } } peers { permanent_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } } }
I20260811 11:47:46.443580 5596 sys_catalog.cc:458] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:47:46.445339 5579 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd82a2112f134d66b8853e8e30c00071" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34463 } } peers { permanent_uuid: "308286d5215e42a39fadacac6f059b9a" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 39435 } } peers { permanent_uuid: "65ccec6b135f4b9b85a80adaccb9f49c" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 45145 } } }
I20260811 11:47:46.445482 5579 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:47:46.446018 5648 mvcc.cc:205] Tried to move back new op lower bound from 7317294556823883776 to 7317294556785577984. Current Snapshot: MvccSnapshot[applied={T|T < 7317294556823883776}]
I20260811 11:47:46.448346 5649 mvcc.cc:205] Tried to move back new op lower bound from 7317294556823883776 to 7317294556785577984. Current Snapshot: MvccSnapshot[applied={T|T < 7317294556823883776}]
I20260811 11:47:46.448583 5651 mvcc.cc:205] Tried to move back new op lower bound from 7317294556823883776 to 7317294556785577984. Current Snapshot: MvccSnapshot[applied={T|T < 7317294556823883776}]
I20260811 11:47:46.450757 5647 catalog_manager.cc:1347] Generated new cluster ID: e6e43a98eae7461f980bb9a5622d05ad
I20260811 11:47:46.450821 5647 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:47:46.483547 5647 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:47:46.485235 5647 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:47:46.503527 5647 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 65ccec6b135f4b9b85a80adaccb9f49c: Generated new TSK 0
I20260811 11:47:46.504393 5647 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:47:47.282354 5614 catalog_manager.cc:1259] Loaded cluster ID: e6e43a98eae7461f980bb9a5622d05ad
I20260811 11:47:47.282354 5594 catalog_manager.cc:1259] Loaded cluster ID: e6e43a98eae7461f980bb9a5622d05ad
I20260811 11:47:47.282465 5594 catalog_manager.cc:1552] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071: loading cluster ID for follower catalog manager: success
I20260811 11:47:47.282465 5614 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a: loading cluster ID for follower catalog manager: success
I20260811 11:47:47.284819 5614 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a: acquiring CA information for follower catalog manager: success
I20260811 11:47:47.284819 5594 catalog_manager.cc:1574] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071: acquiring CA information for follower catalog manager: success
I20260811 11:47:47.286312 5594 catalog_manager.cc:1602] T 00000000000000000000000000000000 P cd82a2112f134d66b8853e8e30c00071: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 11:47:47.286312 5614 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 308286d5215e42a39fadacac6f059b9a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 11:47:47.569659 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 5303
I20260811 11:47:47.580154 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 5396
I20260811 11:47:47.590094 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 5490
2026-08-11T11:47:47Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3322 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:47:47 dist-test-slave-vkjp krb5kdc[5662](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:47:47 dist-test-slave-vkjp krb5kdc[5662](info): set up 2 sockets
Aug 11 11:47:47 dist-test-slave-vkjp krb5kdc[5662](info): commencing operation
krb5kdc: starting...
W20260811 11:47:48.728390 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:47:48 dist-test-slave-vkjp krb5kdc[5662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:47:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:47:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:47:48.866361 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:37947
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:35241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:37947
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:47:48.985500 5679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:48.985839 5679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:48.985925 5679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:48.990075 5679 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:47:48.990171 5679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:48.990209 5679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:48.990263 5679 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:47:48.990299 5679 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:47:48.995906 5679 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:35241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:37947
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:37947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5679
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:48.997067 5679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:48.998147 5679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:47:49.007233 5679 server_base.cc:1034] running on GCE node
W20260811 11:47:49.007241 5688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:49.007215 5685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:49.007196 5686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:49.008122 5679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:49.009284 5679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:49.010494 5679 hybrid_clock.cc:648] HybridClock initialized: now 1786448869010474 us; error 27 us; skew 500 ppm
Aug 11 11:47:49 dist-test-slave-vkjp krb5kdc[5662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448869, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:49.013439 5679 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:47:49.014353 5679 webserver.cc:460] Webserver started at http://127.20.244.126:38975/ using document root <none> and password file <none>
I20260811 11:47:49.014993 5679 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:49.015115 5679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:47:49.015362 5679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:47:49.017519 5679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "e6058b849aa54d06a8bcaa56a8ab7ad4"
format_stamp: "Formatted at 2026-08-11 11:47:49 on dist-test-slave-vkjp"
server_key: "ae791a3a935bc83bca53aa6397a40a36"
server_key_iv: "8d77088ce50843ec3811281c7eafad23"
server_key_version: "encryptionkey@0"
I20260811 11:47:49.018110 5679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "e6058b849aa54d06a8bcaa56a8ab7ad4"
format_stamp: "Formatted at 2026-08-11 11:47:49 on dist-test-slave-vkjp"
server_key: "ae791a3a935bc83bca53aa6397a40a36"
server_key_iv: "8d77088ce50843ec3811281c7eafad23"
server_key_version: "encryptionkey@0"
I20260811 11:47:49.021981 5679 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 11:47:49.024683 5695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:49.026005 5679 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 11:47:49.026152 5679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "e6058b849aa54d06a8bcaa56a8ab7ad4"
format_stamp: "Formatted at 2026-08-11 11:47:49 on dist-test-slave-vkjp"
server_key: "ae791a3a935bc83bca53aa6397a40a36"
server_key_iv: "8d77088ce50843ec3811281c7eafad23"
server_key_version: "encryptionkey@0"
I20260811 11:47:49.026275 5679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:49.044044 5679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:49.046963 5679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:49.047197 5679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:49.054687 5679 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:37947
I20260811 11:47:49.054733 5756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:37947 every 8 connection(s)
I20260811 11:47:49.056083 5679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:47:49.059582 5758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:47:49.063956 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 5679
I20260811 11:47:49.064118 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:47:49.064435 21457 external_mini_cluster.cc:1428] Setting key 84533010b971e211e0798049bd8e201c
I20260811 11:47:49.065645 5758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4: Bootstrap starting.
I20260811 11:47:49.068125 5758 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4: Neither blocks nor log segments found. Creating new log.
I20260811 11:47:49.069051 5758 log.cc:824] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4: Log is configured to *not* fsync() on all Append() calls
I20260811 11:47:49.071336 5758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4: No bootstrap required, opened a new log
Aug 11 11:47:49 dist-test-slave-vkjp krb5kdc[5662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:47:49.076241 5758 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6058b849aa54d06a8bcaa56a8ab7ad4" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37947 } }
I20260811 11:47:49.076540 5758 raft_consensus.cc:374] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:47:49.076617 5758 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6058b849aa54d06a8bcaa56a8ab7ad4, State: Initialized, Role: FOLLOWER
I20260811 11:47:49.077123 5758 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6058b849aa54d06a8bcaa56a8ab7ad4" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37947 } }
I20260811 11:47:49.077255 5758 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:47:49.077297 5758 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:47:49.077457 5758 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:47:49.078404 5758 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6058b849aa54d06a8bcaa56a8ab7ad4" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37947 } }
I20260811 11:47:49.078758 5758 leader_election.cc:302] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6058b849aa54d06a8bcaa56a8ab7ad4; no voters:
I20260811 11:47:49.079137 5758 leader_election.cc:288] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:47:49.079244 5764 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:47:49.079507 5764 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4 [term 1 LEADER]: Becoming Leader. State: Replica: e6058b849aa54d06a8bcaa56a8ab7ad4, State: Running, Role: LEADER
I20260811 11:47:49.079886 5764 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6058b849aa54d06a8bcaa56a8ab7ad4" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37947 } }
I20260811 11:47:49.080416 5762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:49.065891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60960 (local address 127.20.244.126:37947)
0811 11:47:49.066314 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:49.066331 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:49.066367 (+ 36us) server_negotiation.cc:407] Connection header received
0811 11:47:49.067030 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:49.067047 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:49.067435 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:49.067711 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:49.068757 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:49.069914 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:49.071150 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:49.071724 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:49.071868 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:49.074739 (+ 2871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:49.074746 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:49.074763 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:49.074796 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:49.076835 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:49.077428 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:49.077435 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:49.077442 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:49.077639 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:49.077983 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:49.077987 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:49.077989 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:49.078446 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:49.078670 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:49.079025 (+ 355us) server_negotiation.cc:299] Negotiation successful
0811 11:47:49.079431 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":130,"threads_started":1}
I20260811 11:47:49.080554 5758 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:47:49.081683 5767 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e6058b849aa54d06a8bcaa56a8ab7ad4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6058b849aa54d06a8bcaa56a8ab7ad4" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37947 } } }
I20260811 11:47:49.081840 5767 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4 [sys.catalog]: This master's current role is: LEADER
I20260811 11:47:49.082283 5776 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:47:49.083268 5766 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6058b849aa54d06a8bcaa56a8ab7ad4. Latest consensus state: current_term: 1 leader_uuid: "e6058b849aa54d06a8bcaa56a8ab7ad4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6058b849aa54d06a8bcaa56a8ab7ad4" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 37947 } } }
I20260811 11:47:49.083384 5766 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4 [sys.catalog]: This master's current role is: LEADER
I20260811 11:47:49.084183 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:47:49.085520 5776 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:47:49.091614 5776 catalog_manager.cc:1347] Generated new cluster ID: 9434c610073c4ee180d0cf23b3b35c0c
I20260811 11:47:49.091706 5776 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:47:49.111357 5776 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:47:49.112463 5776 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:47:49.120852 5776 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e6058b849aa54d06a8bcaa56a8ab7ad4: Generated new TSK 0
I20260811 11:47:49.121618 5776 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:47:49.141115 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 5679
2026-08-11T11:47:49Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1551 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:47:49 dist-test-slave-vkjp krb5kdc[5791](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:47:49 dist-test-slave-vkjp krb5kdc[5791](info): set up 2 sockets
Aug 11 11:47:49 dist-test-slave-vkjp krb5kdc[5791](info): commencing operation
krb5kdc: starting...
W20260811 11:47:50.374244 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.207s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:47:50 dist-test-slave-vkjp krb5kdc[5791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:47:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:47:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:47:50.515497 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:40461
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:37979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:40461
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:47:50.640267 5809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:50.640607 5809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:50.640686 5809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:50.644979 5809 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:47:50.645079 5809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:50.645121 5809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:50.645175 5809 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:47:50.645210 5809 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:47:50.651031 5809 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:40461
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:40461
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:50.652259 5809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:50.653429 5809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:50.662282 5817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:50.662341 5815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:50.662341 5814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:50.662415 5809 server_base.cc:1034] running on GCE node
I20260811 11:47:50.663223 5809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:50.664450 5809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:50.665675 5809 hybrid_clock.cc:648] HybridClock initialized: now 1786448870665651 us; error 39 us; skew 500 ppm
Aug 11 11:47:50 dist-test-slave-vkjp krb5kdc[5791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448870, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:50.675154 5809 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:47:50.676234 5809 webserver.cc:460] Webserver started at http://127.20.244.126:35171/ using document root <none> and password file <none>
I20260811 11:47:50.676836 5809 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:50.676927 5809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:47:50.677168 5809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:47:50.679417 5809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "0c57b719ce0740d39b2ee894d0a25c1a"
format_stamp: "Formatted at 2026-08-11 11:47:50 on dist-test-slave-vkjp"
server_key: "d8aa978675c0ae872e694be973a8794d"
server_key_iv: "9d12a0a35463461edf432193660dd63f"
server_key_version: "encryptionkey@0"
I20260811 11:47:50.680042 5809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "0c57b719ce0740d39b2ee894d0a25c1a"
format_stamp: "Formatted at 2026-08-11 11:47:50 on dist-test-slave-vkjp"
server_key: "d8aa978675c0ae872e694be973a8794d"
server_key_iv: "9d12a0a35463461edf432193660dd63f"
server_key_version: "encryptionkey@0"
I20260811 11:47:50.684010 5809 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 11:47:50.686559 5825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:50.687860 5809 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 11:47:50.688004 5809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "0c57b719ce0740d39b2ee894d0a25c1a"
format_stamp: "Formatted at 2026-08-11 11:47:50 on dist-test-slave-vkjp"
server_key: "d8aa978675c0ae872e694be973a8794d"
server_key_iv: "9d12a0a35463461edf432193660dd63f"
server_key_version: "encryptionkey@0"
I20260811 11:47:50.688118 5809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:50.706566 5809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:50.710531 5809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:50.710788 5809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:50.718740 5809 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:40461
I20260811 11:47:50.719108 5887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:40461 every 8 connection(s)
I20260811 11:47:50.719904 5809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:47:50.722862 5888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:47:50.724134 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 5809
I20260811 11:47:50.724304 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:47:50.724668 21457 external_mini_cluster.cc:1428] Setting key f280bdac5fea84ad044361c359825367
I20260811 11:47:50.730753 5888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a: Bootstrap starting.
I20260811 11:47:50.733649 5888 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a: Neither blocks nor log segments found. Creating new log.
I20260811 11:47:50.734552 5888 log.cc:824] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a: Log is configured to *not* fsync() on all Append() calls
Aug 11 11:47:50 dist-test-slave-vkjp krb5kdc[5791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:47:50.737017 5888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a: No bootstrap required, opened a new log
I20260811 11:47:50.740718 5888 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40461 } }
I20260811 11:47:50.740886 5893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:50.726087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33826 (local address 127.20.244.126:40461)
0811 11:47:50.726524 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:50.726546 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:50.726594 (+ 48us) server_negotiation.cc:407] Connection header received
0811 11:47:50.727538 (+ 944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:50.727566 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:50.728029 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:50.728468 (+ 439us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:50.729183 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:50.730855 (+ 1672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:50.731867 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:50.732649 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:50.732827 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:50.735729 (+ 2902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:50.735735 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:50.735750 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:50.735783 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:50.737739 (+ 1956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:50.738236 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:50.738242 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:50.738247 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:50.738385 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:50.738684 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:50.738689 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:50.738691 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:50.739184 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:50.739413 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:50.739712 (+ 299us) server_negotiation.cc:299] Negotiation successful
0811 11:47:50.740043 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":111,"threads_started":1}
I20260811 11:47:50.741003 5888 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:47:50.741070 5888 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c57b719ce0740d39b2ee894d0a25c1a, State: Initialized, Role: FOLLOWER
I20260811 11:47:50.741580 5888 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40461 } }
I20260811 11:47:50.741729 5888 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:47:50.741781 5888 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:47:50.741865 5888 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:47:50.742832 5888 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40461 } }
I20260811 11:47:50.743240 5888 leader_election.cc:302] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c57b719ce0740d39b2ee894d0a25c1a; no voters:
I20260811 11:47:50.743583 5888 leader_election.cc:288] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:47:50.743731 5895 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:47:50.744000 5895 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 1 LEADER]: Becoming Leader. State: Replica: 0c57b719ce0740d39b2ee894d0a25c1a, State: Running, Role: LEADER
I20260811 11:47:50.744339 5895 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40461 } }
I20260811 11:47:50.744782 5888 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:47:50.746104 5896 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40461 } } }
I20260811 11:47:50.746162 5897 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c57b719ce0740d39b2ee894d0a25c1a. Latest consensus state: current_term: 1 leader_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40461 } } }
I20260811 11:47:50.746230 5896 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [sys.catalog]: This master's current role is: LEADER
I20260811 11:47:50.746333 5897 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [sys.catalog]: This master's current role is: LEADER
I20260811 11:47:50.746809 5909 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:47:50.750270 5909 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:47:50.757220 5909 catalog_manager.cc:1347] Generated new cluster ID: fa2681496d9d43fd87ea7b7f8d22cf43
I20260811 11:47:50.757319 5909 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:47:50.778050 5909 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:47:50.779531 5909 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:47:50.786944 5909 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a: Generated new TSK 0
I20260811 11:47:50.787842 5909 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.244.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
I20260811 11:47:50.819473 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40461
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:37979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:47:50.944442 5922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:50.944728 5922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:50.944777 5922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:50.949558 5922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:50.949633 5922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:50.949700 5922 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:47:50.955631 5922 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5922
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:50.956772 5922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:50.957825 5922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:50.968305 5928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:50.968364 5929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:50.968461 5922 server_base.cc:1034] running on GCE node
W20260811 11:47:50.968602 5933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:50.969012 5922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:50.969653 5922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:50.970816 5922 hybrid_clock.cc:648] HybridClock initialized: now 1786448870970800 us; error 26 us; skew 500 ppm
Aug 11 11:47:50 dist-test-slave-vkjp krb5kdc[5791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448870, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:50.973740 5922 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:47:50.974637 5922 webserver.cc:460] Webserver started at http://127.20.244.65:42299/ using document root <none> and password file <none>
I20260811 11:47:50.975243 5922 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:50.975309 5922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:47:50.975570 5922 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:47:50.977735 5922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "bde1985323994b6d981397f78f0b4ee8"
format_stamp: "Formatted at 2026-08-11 11:47:50 on dist-test-slave-vkjp"
server_key: "7cd3473bf1040af3b82b558cc07e317c"
server_key_iv: "c9591606e8536a6500487b3e64ae5dfa"
server_key_version: "encryptionkey@0"
I20260811 11:47:50.978320 5922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "bde1985323994b6d981397f78f0b4ee8"
format_stamp: "Formatted at 2026-08-11 11:47:50 on dist-test-slave-vkjp"
server_key: "7cd3473bf1040af3b82b558cc07e317c"
server_key_iv: "c9591606e8536a6500487b3e64ae5dfa"
server_key_version: "encryptionkey@0"
I20260811 11:47:50.982218 5922 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 11:47:50.984752 5943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:50.986065 5922 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 11:47:50.986194 5922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "bde1985323994b6d981397f78f0b4ee8"
format_stamp: "Formatted at 2026-08-11 11:47:50 on dist-test-slave-vkjp"
server_key: "7cd3473bf1040af3b82b558cc07e317c"
server_key_iv: "c9591606e8536a6500487b3e64ae5dfa"
server_key_version: "encryptionkey@0"
I20260811 11:47:50.986306 5922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:51.003173 5922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:51.006230 5922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:51.006436 5922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:51.007040 5922 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:47:51.007911 5922 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:47:51.007964 5922 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:51.008004 5922 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:47:51.008020 5922 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:51.016850 5922 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:34181
I20260811 11:47:51.016889 6087 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:34181 every 8 connection(s)
I20260811 11:47:51.017787 5922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:47:51.027603 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 5922
I20260811 11:47:51.027779 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:47:51.028064 21457 external_mini_cluster.cc:1428] Setting key 56f96d11db2e20d992017fa6ea541b56
Aug 11 11:47:51 dist-test-slave-vkjp krb5kdc[5791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448870, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:47:51.033651 5893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:51.019681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:51657 (local address 127.20.244.126:40461)
0811 11:47:51.019865 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:51.019869 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:51.020686 (+ 817us) server_negotiation.cc:407] Connection header received
0811 11:47:51.022298 (+ 1612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:51.022302 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:51.022364 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:51.022466 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:51.023852 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.024468 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.025740 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.026025 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.026151 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:51.029145 (+ 2994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:51.029148 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:51.029150 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:51.029176 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:51.031204 (+ 2028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:51.031793 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:51.031799 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:51.031804 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:51.031907 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:51.032403 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:51.032405 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:51.032406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:51.032587 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:51.032664 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:51.033417 (+ 753us) server_negotiation.cc:299] Negotiation successful
0811 11:47:51.033526 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 11:47:51.035037 6090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:51.020025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.65:51657)
0811 11:47:51.020507 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:51.020562 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:51.022066 (+ 1504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:51.022663 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:51.022670 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:51.023141 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:51.023691 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:51.023706 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.024618 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.024622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:51.025598 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:51.025608 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.026199 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.026203 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:51.026396 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:51.027115 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:51.027145 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:51.028982 (+ 1837us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:51.031338 (+ 2356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:51.031343 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:51.031357 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:51.031678 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:51.032030 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:51.032037 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:51.032042 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:51.032275 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:51.032699 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:51.032707 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:51.033112 (+ 405us) client_negotiation.cc:769] Sending connection context
0811 11:47:51.033369 (+ 257us) client_negotiation.cc:240] Negotiation successful
0811 11:47:51.033809 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":119,"threads_started":1}
I20260811 11:47:51.036487 6088 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40461
I20260811 11:47:51.036742 6088 heartbeater.cc:464] Registering TS with master...
I20260811 11:47:51.037238 6088 heartbeater.cc:511] Master 127.20.244.126:40461 requested a full tablet report, sending...
I20260811 11:47:51.039002 5843 ts_manager.cc:194] Registered new tserver with Master: bde1985323994b6d981397f78f0b4ee8 (127.20.244.65:34181)
WARNING: no policy specified for kudu/127.20.244.66@KRBTEST.COM; defaulting to no policy
I20260811 11:47:51.041013 5843 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:51657
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
I20260811 11:47:51.063529 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40461
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:37979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:47:51.177771 6093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:51.178025 6093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:51.178071 6093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:51.182152 6093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:51.182214 6093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:51.182318 6093 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:47:51.187664 6093 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6093
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:51.188725 6093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:51.189831 6093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:51.199455 6099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:51.199532 6093 server_base.cc:1034] running on GCE node
W20260811 11:47:51.199579 6101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:51.199484 6098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:51.200255 6093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:51.201045 6093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:51.202275 6093 hybrid_clock.cc:648] HybridClock initialized: now 1786448871202261 us; error 28 us; skew 500 ppm
Aug 11 11:47:51 dist-test-slave-vkjp krb5kdc[5791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448871, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:51.205281 6093 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:47:51.206233 6093 webserver.cc:460] Webserver started at http://127.20.244.66:37677/ using document root <none> and password file <none>
I20260811 11:47:51.206842 6093 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:51.206945 6093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:47:51.207235 6093 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:47:51.209434 6093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "187e6eea0db54d77a5b250c10bda2aa3"
format_stamp: "Formatted at 2026-08-11 11:47:51 on dist-test-slave-vkjp"
server_key: "38280610d42672be1ee814cc603b1bc2"
server_key_iv: "89c0308fa156074132a1b595a4cdb3d9"
server_key_version: "encryptionkey@0"
I20260811 11:47:51.210045 6093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "187e6eea0db54d77a5b250c10bda2aa3"
format_stamp: "Formatted at 2026-08-11 11:47:51 on dist-test-slave-vkjp"
server_key: "38280610d42672be1ee814cc603b1bc2"
server_key_iv: "89c0308fa156074132a1b595a4cdb3d9"
server_key_version: "encryptionkey@0"
I20260811 11:47:51.214259 6093 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 11:47:51.217062 6112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:51.218469 6093 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 11:47:51.218626 6093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "187e6eea0db54d77a5b250c10bda2aa3"
format_stamp: "Formatted at 2026-08-11 11:47:51 on dist-test-slave-vkjp"
server_key: "38280610d42672be1ee814cc603b1bc2"
server_key_iv: "89c0308fa156074132a1b595a4cdb3d9"
server_key_version: "encryptionkey@0"
I20260811 11:47:51.218753 6093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:51.263262 6093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:51.266458 6093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:51.266659 6093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:51.267325 6093 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:47:51.268177 6093 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:47:51.268244 6093 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:51.268324 6093 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:47:51.268371 6093 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:51.277518 6093 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:42363
I20260811 11:47:51.277563 6251 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:42363 every 8 connection(s)
I20260811 11:47:51.278455 6093 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:47:51.282385 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 6093
I20260811 11:47:51.282492 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:47:51.282774 21457 external_mini_cluster.cc:1428] Setting key 12022c3afe0c589434c23ee64a1131e8
Aug 11 11:47:51 dist-test-slave-vkjp krb5kdc[5791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448871, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:47:51.294188 5893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:51.280297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:58233 (local address 127.20.244.126:40461)
0811 11:47:51.280478 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:51.280483 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:51.281294 (+ 811us) server_negotiation.cc:407] Connection header received
0811 11:47:51.282768 (+ 1474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:51.282771 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:51.282831 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:51.282918 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:51.284465 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.284990 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.286140 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.286557 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.286676 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:51.289836 (+ 3160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:51.289844 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:51.289850 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:51.289885 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:51.291694 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:51.292354 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:51.292358 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:51.292360 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:51.292469 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:51.292915 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:51.292918 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:51.292919 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:51.293108 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:51.293183 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:51.293925 (+ 742us) server_negotiation.cc:299] Negotiation successful
0811 11:47:51.294046 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
WARNING: no policy specified for kudu/127.20.244.67@KRBTEST.COM; defaulting to no policy
I20260811 11:47:51.295305 6255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:51.280676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.66:58233)
0811 11:47:51.281144 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:51.281187 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:51.282527 (+ 1340us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:51.283127 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:51.283136 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:51.283635 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:51.284306 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:51.284326 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.285116 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.285120 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:51.286013 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:51.286023 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.286790 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.286793 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:51.286948 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:51.287659 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:51.287676 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:51.289559 (+ 1883us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:51.291818 (+ 2259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:51.291825 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:51.291843 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:51.292225 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:51.292597 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:51.292601 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:51.292603 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:51.292808 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:51.293213 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:51.293220 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:51.293598 (+ 378us) client_negotiation.cc:769] Sending connection context
0811 11:47:51.293858 (+ 260us) client_negotiation.cc:240] Negotiation successful
0811 11:47:51.294232 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":133,"threads_started":1}
I20260811 11:47:51.296564 6253 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40461
I20260811 11:47:51.296804 6253 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.67@KRBTEST.COM" created.
I20260811 11:47:51.297451 6253 heartbeater.cc:511] Master 127.20.244.126:40461 requested a full tablet report, sending...
I20260811 11:47:51.298573 5843 ts_manager.cc:194] Registered new tserver with Master: 187e6eea0db54d77a5b250c10bda2aa3 (127.20.244.66:42363)
I20260811 11:47:51.299225 5843 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:58233
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
I20260811 11:47:51.314985 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40461
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:37979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:47:51.426951 6259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:51.427269 6259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:51.427349 6259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:51.431310 6259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:51.431401 6259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:51.431496 6259 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:47:51.436713 6259 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6259
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:51.437832 6259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:51.438903 6259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:51.448846 6267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:51.448846 6269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:51.448882 6265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:51.449138 6259 server_base.cc:1034] running on GCE node
I20260811 11:47:51.449633 6259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:51.450299 6259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:51.451457 6259 hybrid_clock.cc:648] HybridClock initialized: now 1786448871451441 us; error 26 us; skew 500 ppm
Aug 11 11:47:51 dist-test-slave-vkjp krb5kdc[5791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448871, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:51.454147 6259 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:47:51.455143 6259 webserver.cc:460] Webserver started at http://127.20.244.67:39883/ using document root <none> and password file <none>
I20260811 11:47:51.455767 6259 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:51.455859 6259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:47:51.456089 6259 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:47:51.458146 6259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "2d30217e964f44318106a8946af8790a"
format_stamp: "Formatted at 2026-08-11 11:47:51 on dist-test-slave-vkjp"
server_key: "916efe636ed9686fe0f61a6d7ce8a42c"
server_key_iv: "dfd44761f655a3040417dfcd4dc382f9"
server_key_version: "encryptionkey@0"
I20260811 11:47:51.458719 6259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "2d30217e964f44318106a8946af8790a"
format_stamp: "Formatted at 2026-08-11 11:47:51 on dist-test-slave-vkjp"
server_key: "916efe636ed9686fe0f61a6d7ce8a42c"
server_key_iv: "dfd44761f655a3040417dfcd4dc382f9"
server_key_version: "encryptionkey@0"
I20260811 11:47:51.462577 6259 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 11:47:51.465116 6276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:51.466421 6259 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:47:51.466559 6259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "2d30217e964f44318106a8946af8790a"
format_stamp: "Formatted at 2026-08-11 11:47:51 on dist-test-slave-vkjp"
server_key: "916efe636ed9686fe0f61a6d7ce8a42c"
server_key_iv: "dfd44761f655a3040417dfcd4dc382f9"
server_key_version: "encryptionkey@0"
I20260811 11:47:51.466671 6259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:51.497686 6259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:51.500672 6259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:51.500878 6259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:51.501494 6259 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:47:51.502331 6259 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:47:51.502396 6259 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:51.502465 6259 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:47:51.502511 6259 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:51.511462 6259 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:35419
I20260811 11:47:51.511490 6414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:35419 every 8 connection(s)
I20260811 11:47:51.512416 6259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:47:51.522388 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 6259
Aug 11 11:47:51 dist-test-slave-vkjp krb5kdc[5791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448871, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:47:51.522543 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:47:51.522884 21457 external_mini_cluster.cc:1428] Setting key bb44d44944f34245cadc304756c28e06
I20260811 11:47:51.527172 5893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:51.514277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:60717 (local address 127.20.244.126:40461)
0811 11:47:51.514488 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:51.514492 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:51.515296 (+ 804us) server_negotiation.cc:407] Connection header received
0811 11:47:51.516763 (+ 1467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:51.516767 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:51.516861 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:51.516955 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:51.518196 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.518753 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.520041 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.520271 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.520405 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:51.523312 (+ 2907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:51.523316 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:51.523319 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:51.523353 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:51.525053 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:51.525674 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:51.525677 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:51.525678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:51.525763 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:51.526080 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:51.526083 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:51.526084 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:51.526266 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:51.526342 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:51.526865 (+ 523us) server_negotiation.cc:299] Negotiation successful
0811 11:47:51.526983 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260811 11:47:51.527945 6417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:51.514651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.67:60717)
0811 11:47:51.515147 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:51.515192 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:51.516545 (+ 1353us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:51.517136 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:51.517143 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:51.517515 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:51.518023 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:51.518037 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.518906 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.518914 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:51.519910 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:51.519921 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.520446 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.520451 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:51.520633 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:51.521211 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:51.521227 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:51.523059 (+ 1832us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:51.525206 (+ 2147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:51.525218 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:51.525230 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:51.525564 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:51.525860 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:51.525862 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:51.525863 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:51.525994 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:51.526351 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:51.526356 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:51.526584 (+ 228us) client_negotiation.cc:769] Sending connection context
0811 11:47:51.526736 (+ 152us) client_negotiation.cc:240] Negotiation successful
0811 11:47:51.527015 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":114,"threads_started":1}
I20260811 11:47:51.529161 6415 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40461
I20260811 11:47:51.529470 6415 heartbeater.cc:464] Registering TS with master...
I20260811 11:47:51.529923 6415 heartbeater.cc:511] Master 127.20.244.126:40461 requested a full tablet report, sending...
I20260811 11:47:51.530928 5843 ts_manager.cc:194] Registered new tserver with Master: 2d30217e964f44318106a8946af8790a (127.20.244.67:35419)
I20260811 11:47:51.531631 5843 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:60717
I20260811 11:47:51.537125 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:47:51.546453 5893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:51.539140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33838 (local address 127.20.244.126:40461)
0811 11:47:51.539283 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:51.539288 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:51.539494 (+ 206us) server_negotiation.cc:407] Connection header received
0811 11:47:51.539585 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:51.539587 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:51.539629 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:51.539695 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:51.540369 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.540869 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.541667 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.541890 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.541969 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:51.543213 (+ 1244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:51.543216 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:51.543218 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:51.543241 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:51.544771 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:51.545136 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:51.545138 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:51.545139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:51.545212 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:51.545564 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:51.545569 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:51.545573 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:51.545825 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:51.545930 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:51.546128 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 11:47:51.546227 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 11:47:51.549551 5843 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33838:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:47:51.552704 5843 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:47:51.566962 6434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:51.561125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:34181 (local address 127.0.0.1:47630)
0811 11:47:51.561925 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:51.561942 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:51.562070 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:51.562840 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:51.562842 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:51.562864 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:47:51.563104 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:51.563111 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.564113 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.564118 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:51.565353 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:51.565364 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.566414 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.566417 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:51.566522 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:51.566558 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 11:47:51.566687 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 11:47:51.566811 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":726,"mutex_wait_us":53,"spinlock_wait_cycles":9856,"thread_start_us":110,"threads_started":1}
I20260811 11:47:51.566965 6435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:51.561838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47630 (local address 127.20.244.65:34181)
0811 11:47:51.562466 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:51.562473 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:51.562492 (+ 19us) server_negotiation.cc:407] Connection header received
0811 11:47:51.562558 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:51.562563 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:51.562733 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:51.562868 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:47:51.563235 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.563996 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.565504 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.566287 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.566406 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:51.566555 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:51.566721 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 11:47:51.566814 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":97,"threads_started":1}
I20260811 11:47:51.567399 6430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:51.561037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:42363 (local address 127.0.0.1:45032)
0811 11:47:51.561874 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:51.561929 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:51.562106 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:51.562818 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:51.562825 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:51.562850 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:47:51.563123 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:51.563131 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.564661 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.564664 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:51.565731 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:51.565740 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.566916 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.566921 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:51.567022 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:51.567053 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 11:47:51.567195 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 11:47:51.567267 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":663,"mutex_wait_us":48,"thread_start_us":87,"threads_started":1}
I20260811 11:47:51.567499 6432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:51.561168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45032 (local address 127.20.244.66:42363)
0811 11:47:51.561616 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:51.561628 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:51.562026 (+ 398us) server_negotiation.cc:407] Connection header received
0811 11:47:51.562278 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:51.562285 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:51.562515 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:51.562650 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:47:51.563293 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.564457 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.565850 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.566604 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.566707 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:51.566848 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:51.567254 (+ 406us) server_negotiation.cc:299] Negotiation successful
0811 11:47:51.567364 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":156,"threads_started":1}
I20260811 11:47:51.568033 6431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:51.561404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:35419 (local address 127.0.0.1:54860)
0811 11:47:51.562285 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:51.562301 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:51.562390 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:51.562988 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:51.562991 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:51.563006 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:47:51.563161 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:51.563169 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.564617 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.564621 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:51.566003 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:51.566013 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.567537 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.567543 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:51.567720 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:51.567747 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 11:47:51.567833 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 11:47:51.567901 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":824,"mutex_wait_us":56,"thread_start_us":81,"threads_started":1}
I20260811 11:47:51.568820 6436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:51.561836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54860 (local address 127.20.244.67:35419)
0811 11:47:51.562263 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:51.562274 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:51.562479 (+ 205us) server_negotiation.cc:407] Connection header received
0811 11:47:51.562559 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:51.562563 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:51.562732 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:51.562868 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:47:51.563282 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.564467 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.566129 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.566953 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.567238 (+ 285us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:51.567384 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:51.567867 (+ 483us) server_negotiation.cc:299] Negotiation successful
0811 11:47:51.568671 (+ 804us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":108,"threads_started":1}
I20260811 11:47:51.570106 6001 tablet_service.cc:1467] Processing CreateTablet for tablet dea5f6667a7a45fc95bda527efdcd73a (DEFAULT_TABLE table=test-table [id=e3ab0181146a4126bb6c9b05aea07f71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:47:51.570127 6173 tablet_service.cc:1467] Processing CreateTablet for tablet dea5f6667a7a45fc95bda527efdcd73a (DEFAULT_TABLE table=test-table [id=e3ab0181146a4126bb6c9b05aea07f71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:47:51.571146 6001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dea5f6667a7a45fc95bda527efdcd73a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:47:51.571144 6173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dea5f6667a7a45fc95bda527efdcd73a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:47:51.577493 6438 tablet_bootstrap.cc:492] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8: Bootstrap starting.
I20260811 11:47:51.577962 6437 tablet_bootstrap.cc:492] T dea5f6667a7a45fc95bda527efdcd73a P 187e6eea0db54d77a5b250c10bda2aa3: Bootstrap starting.
I20260811 11:47:51.578308 6336 tablet_service.cc:1467] Processing CreateTablet for tablet dea5f6667a7a45fc95bda527efdcd73a (DEFAULT_TABLE table=test-table [id=e3ab0181146a4126bb6c9b05aea07f71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:47:51.579353 6336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dea5f6667a7a45fc95bda527efdcd73a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:47:51.580057 6438 tablet_bootstrap.cc:654] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8: Neither blocks nor log segments found. Creating new log.
I20260811 11:47:51.580760 6438 log.cc:824] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8: Log is configured to *not* fsync() on all Append() calls
I20260811 11:47:51.581485 6437 tablet_bootstrap.cc:654] T dea5f6667a7a45fc95bda527efdcd73a P 187e6eea0db54d77a5b250c10bda2aa3: Neither blocks nor log segments found. Creating new log.
I20260811 11:47:51.582432 6437 log.cc:824] T dea5f6667a7a45fc95bda527efdcd73a P 187e6eea0db54d77a5b250c10bda2aa3: Log is configured to *not* fsync() on all Append() calls
I20260811 11:47:51.582957 6438 tablet_bootstrap.cc:492] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8: No bootstrap required, opened a new log
I20260811 11:47:51.583185 6438 ts_tablet_manager.cc:1397] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 11:47:51.584496 6437 tablet_bootstrap.cc:492] T dea5f6667a7a45fc95bda527efdcd73a P 187e6eea0db54d77a5b250c10bda2aa3: No bootstrap required, opened a new log
I20260811 11:47:51.584683 6437 ts_tablet_manager.cc:1397] T dea5f6667a7a45fc95bda527efdcd73a P 187e6eea0db54d77a5b250c10bda2aa3: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260811 11:47:51.587090 6438 raft_consensus.cc:348] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } } peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } }
I20260811 11:47:51.587582 6438 raft_consensus.cc:374] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:47:51.587647 6438 raft_consensus.cc:729] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde1985323994b6d981397f78f0b4ee8, State: Initialized, Role: FOLLOWER
I20260811 11:47:51.588205 6438 consensus_queue.cc:260] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } } peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } }
I20260811 11:47:51.588683 6441 tablet_bootstrap.cc:492] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a: Bootstrap starting.
I20260811 11:47:51.588850 6437 raft_consensus.cc:348] T dea5f6667a7a45fc95bda527efdcd73a P 187e6eea0db54d77a5b250c10bda2aa3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } } peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } }
I20260811 11:47:51.589114 6437 raft_consensus.cc:374] T dea5f6667a7a45fc95bda527efdcd73a P 187e6eea0db54d77a5b250c10bda2aa3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:47:51.589181 6437 raft_consensus.cc:729] T dea5f6667a7a45fc95bda527efdcd73a P 187e6eea0db54d77a5b250c10bda2aa3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 187e6eea0db54d77a5b250c10bda2aa3, State: Initialized, Role: FOLLOWER
I20260811 11:47:51.589355 6438 ts_tablet_manager.cc:1428] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260811 11:47:51.589788 6088 heartbeater.cc:503] Master 127.20.244.126:40461 was elected leader, sending a full tablet report...
I20260811 11:47:51.591499 6437 consensus_queue.cc:260] T dea5f6667a7a45fc95bda527efdcd73a P 187e6eea0db54d77a5b250c10bda2aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } } peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } }
I20260811 11:47:51.592631 6437 ts_tablet_manager.cc:1428] T dea5f6667a7a45fc95bda527efdcd73a P 187e6eea0db54d77a5b250c10bda2aa3: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260811 11:47:51.592770 6441 tablet_bootstrap.cc:654] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a: Neither blocks nor log segments found. Creating new log.
I20260811 11:47:51.593127 6253 heartbeater.cc:503] Master 127.20.244.126:40461 was elected leader, sending a full tablet report...
I20260811 11:47:51.594375 6441 log.cc:824] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a: Log is configured to *not* fsync() on all Append() calls
I20260811 11:47:51.596997 6441 tablet_bootstrap.cc:492] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a: No bootstrap required, opened a new log
I20260811 11:47:51.597206 6441 ts_tablet_manager.cc:1397] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260811 11:47:51.600333 6441 raft_consensus.cc:348] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } } peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } }
I20260811 11:47:51.600557 6441 raft_consensus.cc:374] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:47:51.600636 6441 raft_consensus.cc:729] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d30217e964f44318106a8946af8790a, State: Initialized, Role: FOLLOWER
I20260811 11:47:51.601101 6441 consensus_queue.cc:260] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } } peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } }
I20260811 11:47:51.601770 6415 heartbeater.cc:503] Master 127.20.244.126:40461 was elected leader, sending a full tablet report...
I20260811 11:47:51.602026 6441 ts_tablet_manager.cc:1428] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 11:47:51.709722 6446 raft_consensus.cc:482] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:47:51.709936 6446 raft_consensus.cc:504] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } } peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } }
I20260811 11:47:51.711153 6446 leader_election.cc:288] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 187e6eea0db54d77a5b250c10bda2aa3 (127.20.244.66:42363), bde1985323994b6d981397f78f0b4ee8 (127.20.244.65:34181)
I20260811 11:47:51.716492 6435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:51.712142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:56747 (local address 127.20.244.65:34181)
0811 11:47:51.712282 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:51.712286 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:51.712300 (+ 14us) server_negotiation.cc:407] Connection header received
0811 11:47:51.712364 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:51.712366 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:51.712410 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:51.712506 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:47:51.712798 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.713521 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.715116 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.715763 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.715884 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:51.715944 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:51.716289 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 11:47:51.716361 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 11:47:51.716492 6432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:51.711717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:54105 (local address 127.20.244.66:42363)
0811 11:47:51.711871 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:51.711876 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:51.711899 (+ 23us) server_negotiation.cc:407] Connection header received
0811 11:47:51.711963 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:51.711966 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:51.712020 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:51.712101 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:47:51.712520 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.713319 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.715116 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.715762 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.715891 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:51.715944 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:51.716289 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 11:47:51.716359 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 11:47:51.716552 6447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:51.711458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:34181 (local address 127.20.244.67:56747)
0811 11:47:51.712100 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:51.712114 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:51.712201 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:51.712566 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:51.712568 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:51.712585 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:47:51.712683 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:51.712687 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.713637 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.713641 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:51.714949 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:51.714957 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.715891 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.715895 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:51.716084 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:51.716188 (+ 104us) client_negotiation.cc:769] Sending connection context
0811 11:47:51.716261 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 11:47:51.716369 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"mutex_wait_us":319,"thread_start_us":149,"threads_started":1}
I20260811 11:47:51.716790 6417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:51.711458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:42363 (local address 127.20.244.67:54105)
0811 11:47:51.711688 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:51.711707 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:51.711813 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:51.712229 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:51.712235 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:51.712252 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:47:51.712382 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:51.712390 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.713487 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.713490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:51.714944 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:51.714957 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.715891 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.715895 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:51.716105 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:51.716180 (+ 75us) client_negotiation.cc:769] Sending connection context
0811 11:47:51.716261 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 11:47:51.716369 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"mutex_wait_us":143}
I20260811 11:47:51.717384 6030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dea5f6667a7a45fc95bda527efdcd73a" candidate_uuid: "2d30217e964f44318106a8946af8790a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde1985323994b6d981397f78f0b4ee8" is_pre_election: true
I20260811 11:47:51.717386 6197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dea5f6667a7a45fc95bda527efdcd73a" candidate_uuid: "2d30217e964f44318106a8946af8790a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "187e6eea0db54d77a5b250c10bda2aa3" is_pre_election: true
I20260811 11:47:51.717695 6197 raft_consensus.cc:2454] T dea5f6667a7a45fc95bda527efdcd73a P 187e6eea0db54d77a5b250c10bda2aa3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d30217e964f44318106a8946af8790a in term 0.
I20260811 11:47:51.717698 6030 raft_consensus.cc:2454] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d30217e964f44318106a8946af8790a in term 0.
I20260811 11:47:51.718183 6281 leader_election.cc:302] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d30217e964f44318106a8946af8790a, bde1985323994b6d981397f78f0b4ee8; no voters:
I20260811 11:47:51.718487 6446 raft_consensus.cc:2781] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:47:51.718662 6446 raft_consensus.cc:482] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:47:51.718740 6446 raft_consensus.cc:3037] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:47:51.719836 6446 raft_consensus.cc:504] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } } peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } }
I20260811 11:47:51.720224 6446 leader_election.cc:288] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a [CANDIDATE]: Term 1 election: Requested vote from peers 187e6eea0db54d77a5b250c10bda2aa3 (127.20.244.66:42363), bde1985323994b6d981397f78f0b4ee8 (127.20.244.65:34181)
I20260811 11:47:51.720559 6197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dea5f6667a7a45fc95bda527efdcd73a" candidate_uuid: "2d30217e964f44318106a8946af8790a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "187e6eea0db54d77a5b250c10bda2aa3"
I20260811 11:47:51.720695 6197 raft_consensus.cc:3037] T dea5f6667a7a45fc95bda527efdcd73a P 187e6eea0db54d77a5b250c10bda2aa3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:47:51.721968 6197 raft_consensus.cc:2454] T dea5f6667a7a45fc95bda527efdcd73a P 187e6eea0db54d77a5b250c10bda2aa3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d30217e964f44318106a8946af8790a in term 1.
I20260811 11:47:51.722261 6280 leader_election.cc:302] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 187e6eea0db54d77a5b250c10bda2aa3, 2d30217e964f44318106a8946af8790a; no voters:
I20260811 11:47:51.722317 6030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dea5f6667a7a45fc95bda527efdcd73a" candidate_uuid: "2d30217e964f44318106a8946af8790a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde1985323994b6d981397f78f0b4ee8"
I20260811 11:47:51.722473 6446 raft_consensus.cc:2781] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:47:51.722461 6030 raft_consensus.cc:3037] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:47:51.722700 6446 raft_consensus.cc:686] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a [term 1 LEADER]: Becoming Leader. State: Replica: 2d30217e964f44318106a8946af8790a, State: Running, Role: LEADER
I20260811 11:47:51.723134 6446 consensus_queue.cc:237] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } } peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } }
I20260811 11:47:51.723768 6030 raft_consensus.cc:2454] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d30217e964f44318106a8946af8790a in term 1.
I20260811 11:47:51.728536 5842 catalog_manager.cc:5495] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d30217e964f44318106a8946af8790a (127.20.244.67). New cstate: current_term: 1 leader_uuid: "2d30217e964f44318106a8946af8790a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } health_report { overall_health: HEALTHY } } }
I20260811 11:47:51.757421 6436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:51.753999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54874 (local address 127.20.244.67:35419)
0811 11:47:51.754126 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:51.754130 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:51.754144 (+ 14us) server_negotiation.cc:407] Connection header received
0811 11:47:51.754220 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:51.754223 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:51.754275 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:51.754415 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:47:51.754635 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.755162 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.755997 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:51.756226 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:51.756357 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:51.756620 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:47:51.757043 (+ 423us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:47:51.757137 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:51.757193 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 11:47:51.757245 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
W20260811 11:47:51.763361 6416 tablet.cc:2369] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:47:51.763489 6030 raft_consensus.cc:1261] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Refusing update from remote peer 2d30217e964f44318106a8946af8790a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:47:51.763514 6197 raft_consensus.cc:1261] T dea5f6667a7a45fc95bda527efdcd73a P 187e6eea0db54d77a5b250c10bda2aa3 [term 1 FOLLOWER]: Refusing update from remote peer 2d30217e964f44318106a8946af8790a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:47:51.764219 6446 consensus_queue.cc:1035] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:47:51.764472 6449 consensus_queue.cc:1035] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a [LEADER]: Connected to new peer: Peer: permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 11:47:51.769199 6089 tablet.cc:2369] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:47:51.773396 6458 mvcc.cc:205] Tried to move back new op lower bound from 7317294578735271936 to 7317294578581372928. Current Snapshot: MvccSnapshot[applied={T|T < 7317294578735271936 or (T in {7317294578735271936})}]
I20260811 11:47:51.774225 6457 mvcc.cc:205] Tried to move back new op lower bound from 7317294578735271936 to 7317294578581372928. Current Snapshot: MvccSnapshot[applied={T|T < 7317294578735271936}]
I20260811 11:47:51.780073 5842 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:47:51.780262 5842 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:47:51.782584 5842 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a: Sending DeleteTablet for 3 replicas of tablet dea5f6667a7a45fc95bda527efdcd73a
I20260811 11:47:51.783352 6173 tablet_service.cc:1514] Processing DeleteTablet for tablet dea5f6667a7a45fc95bda527efdcd73a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:47:51 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:45032
I20260811 11:47:51.783424 6001 tablet_service.cc:1514] Processing DeleteTablet for tablet dea5f6667a7a45fc95bda527efdcd73a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:47:51 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:47630
I20260811 11:47:51.783520 6336 tablet_service.cc:1514] Processing DeleteTablet for tablet dea5f6667a7a45fc95bda527efdcd73a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:47:51 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:54860
I20260811 11:47:51.783926 6468 tablet_replica.cc:330] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8: stopping tablet replica
I20260811 11:47:51.784070 6469 tablet_replica.cc:330] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a: stopping tablet replica
I20260811 11:47:51.784209 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 5922
I20260811 11:47:51.784255 6468 raft_consensus.cc:2229] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:47:51.784574 6468 raft_consensus.cc:2258] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:47:51.788235 6469 raft_consensus.cc:2229] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:47:51.788652 6469 raft_consensus.cc:2258] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:47:51.790411 6469 ts_tablet_manager.cc:1905] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:47:51.791721 6467 tablet_replica.cc:330] T dea5f6667a7a45fc95bda527efdcd73a P 187e6eea0db54d77a5b250c10bda2aa3: stopping tablet replica
I20260811 11:47:51.792208 6467 raft_consensus.cc:2229] T dea5f6667a7a45fc95bda527efdcd73a P 187e6eea0db54d77a5b250c10bda2aa3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:47:51.792616 6467 raft_consensus.cc:2258] T dea5f6667a7a45fc95bda527efdcd73a P 187e6eea0db54d77a5b250c10bda2aa3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:47:51.794040 6469 ts_tablet_manager.cc:1918] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:47:51.794152 6469 log.cc:1196] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/dea5f6667a7a45fc95bda527efdcd73a
I20260811 11:47:51.794271 6467 ts_tablet_manager.cc:1905] T dea5f6667a7a45fc95bda527efdcd73a P 187e6eea0db54d77a5b250c10bda2aa3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:47:51.794731 6469 ts_tablet_manager.cc:1939] T dea5f6667a7a45fc95bda527efdcd73a P 2d30217e964f44318106a8946af8790a: Deleting consensus metadata
I20260811 11:47:51.796450 5827 catalog_manager.cc:4841] TS 2d30217e964f44318106a8946af8790a (127.20.244.67:35419): tablet dea5f6667a7a45fc95bda527efdcd73a (table test-table [id=e3ab0181146a4126bb6c9b05aea07f71]) successfully deleted
I20260811 11:47:51.797050 6467 ts_tablet_manager.cc:1918] T dea5f6667a7a45fc95bda527efdcd73a P 187e6eea0db54d77a5b250c10bda2aa3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:47:51.797147 6467 log.cc:1196] T dea5f6667a7a45fc95bda527efdcd73a P 187e6eea0db54d77a5b250c10bda2aa3: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/dea5f6667a7a45fc95bda527efdcd73a
I20260811 11:47:51.797442 6467 ts_tablet_manager.cc:1939] T dea5f6667a7a45fc95bda527efdcd73a P 187e6eea0db54d77a5b250c10bda2aa3: Deleting consensus metadata
W20260811 11:47:51.798084 5830 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.244.65:34181 (error 108)
I20260811 11:47:51.798602 5829 catalog_manager.cc:4841] TS 187e6eea0db54d77a5b250c10bda2aa3 (127.20.244.66:42363): tablet dea5f6667a7a45fc95bda527efdcd73a (table test-table [id=e3ab0181146a4126bb6c9b05aea07f71]) successfully deleted
I20260811 11:47:51.799252 6431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:51.798888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:34181 (local address 127.0.0.1:47634)
0811 11:47:51.799027 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:51.799138 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.65:34181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 11:47:51.799432 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 6093
W20260811 11:47:51.799477 5830 catalog_manager.cc:4584] TS bde1985323994b6d981397f78f0b4ee8 (127.20.244.65:34181): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dea5f6667a7a45fc95bda527efdcd73a: Network error: Client connection negotiation failed: client connection to 127.20.244.65:34181: connect: Connection refused (error 111)
I20260811 11:47:51.811499 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 6259
I20260811 11:47:51.821187 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 5809
I20260811 11:47:51.830482 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:40461
--webserver_interface=127.20.244.126
--webserver_port=35171
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:37979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:40461
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:47:51.946120 6471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:51.946405 6471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:51.946470 6471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:51.950683 6471 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:47:51.950750 6471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:51.950769 6471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:51.950788 6471 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:47:51.950802 6471 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:47:51.956401 6471 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:40461
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:40461
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=35171
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:51.957525 6471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:51.958572 6471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:51.973933 6479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:51.973997 6471 server_base.cc:1034] running on GCE node
W20260811 11:47:51.973989 6480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:51.973933 6483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:51.974876 6471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:51.976162 6471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:51.977372 6471 hybrid_clock.cc:648] HybridClock initialized: now 1786448871977351 us; error 40 us; skew 500 ppm
Aug 11 11:47:51 dist-test-slave-vkjp krb5kdc[5791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448871, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:51.980579 6471 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:47:51.981571 6471 webserver.cc:460] Webserver started at http://127.20.244.126:35171/ using document root <none> and password file <none>
I20260811 11:47:51.982179 6471 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:51.982311 6471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:47:51.986605 6471 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 11:47:51.989063 6492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:51.990422 6471 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:47:51.990572 6471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "0c57b719ce0740d39b2ee894d0a25c1a"
format_stamp: "Formatted at 2026-08-11 11:47:50 on dist-test-slave-vkjp"
server_key: "d8aa978675c0ae872e694be973a8794d"
server_key_iv: "9d12a0a35463461edf432193660dd63f"
server_key_version: "encryptionkey@0"
I20260811 11:47:51.991288 6471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:52.004009 6471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:52.007323 6471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:52.007544 6471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:52.015276 6471 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:40461
I20260811 11:47:52.015720 6561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:40461 every 8 connection(s)
I20260811 11:47:52.016485 6471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:47:52.017951 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 6471
I20260811 11:47:52.018507 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:34181
--local_ip_for_outbound_sockets=127.20.244.65
--tserver_master_addrs=127.20.244.126:40461
--webserver_port=42299
--webserver_interface=127.20.244.65
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:37979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:47:52.022333 6562 sys_catalog.cc:263] Verifying existing consensus state
I20260811 11:47:52.024286 6562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a: Bootstrap starting.
I20260811 11:47:52.043361 6562 log.cc:824] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a: Log is configured to *not* fsync() on all Append() calls
I20260811 11:47:52.053077 6562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:47:52.053542 6562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a: Bootstrap complete.
I20260811 11:47:52.058184 6562 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40461 } }
I20260811 11:47:52.058617 6562 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c57b719ce0740d39b2ee894d0a25c1a, State: Initialized, Role: FOLLOWER
I20260811 11:47:52.059252 6562 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40461 } }
I20260811 11:47:52.059391 6562 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:47:52.059490 6562 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:47:52.059612 6562 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 1 FOLLOWER]: Advancing to term 2
I20260811 11:47:52.061753 6562 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40461 } }
I20260811 11:47:52.062126 6562 leader_election.cc:302] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c57b719ce0740d39b2ee894d0a25c1a; no voters:
I20260811 11:47:52.062511 6562 leader_election.cc:288] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 11:47:52.062646 6566 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 2 FOLLOWER]: Leader election won for term 2
I20260811 11:47:52.062911 6566 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 2 LEADER]: Becoming Leader. State: Replica: 0c57b719ce0740d39b2ee894d0a25c1a, State: Running, Role: LEADER
I20260811 11:47:52.063308 6566 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40461 } }
I20260811 11:47:52.063961 6562 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:47:52.065104 6568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c57b719ce0740d39b2ee894d0a25c1a. Latest consensus state: current_term: 2 leader_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40461 } } }
I20260811 11:47:52.065289 6568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [sys.catalog]: This master's current role is: LEADER
I20260811 11:47:52.065697 6567 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40461 } } }
I20260811 11:47:52.065824 6567 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [sys.catalog]: This master's current role is: LEADER
I20260811 11:47:52.066303 6579 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:47:52.071583 6579 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:47:52.072328 6579 catalog_manager.cc:1259] Loaded cluster ID: fa2681496d9d43fd87ea7b7f8d22cf43
I20260811 11:47:52.072399 6579 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:47:52.074038 6579 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 11:47:52.079651 6579 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 11:47:52.085860 6579 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:47:52.086730 6579 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a: Loaded TSK: 0
I20260811 11:47:52.088080 6579 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 11:47:52.142338 6564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:52.142664 6564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:52.142741 6564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:52.146903 6564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:52.146994 6564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:52.147102 6564 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:47:52.152771 6564 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:34181
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=42299
--tserver_master_addrs=127.20.244.126:40461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6564
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:52.153925 6564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:52.154996 6564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:52.165894 6597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:52.165922 6598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:52.166093 6601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:52.166755 6564 server_base.cc:1034] running on GCE node
I20260811 11:47:52.167309 6564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:52.168064 6564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:52.169229 6564 hybrid_clock.cc:648] HybridClock initialized: now 1786448872169205 us; error 54 us; skew 500 ppm
Aug 11 11:47:52 dist-test-slave-vkjp krb5kdc[5791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448872, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:52.172897 6564 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:47:52.174006 6564 webserver.cc:460] Webserver started at http://127.20.244.65:42299/ using document root <none> and password file <none>
I20260811 11:47:52.174712 6564 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:52.174826 6564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:47:52.180128 6564 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 11:47:52.182825 6609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:52.184449 6564 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:47:52.184572 6564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "bde1985323994b6d981397f78f0b4ee8"
format_stamp: "Formatted at 2026-08-11 11:47:50 on dist-test-slave-vkjp"
server_key: "7cd3473bf1040af3b82b558cc07e317c"
server_key_iv: "c9591606e8536a6500487b3e64ae5dfa"
server_key_version: "encryptionkey@0"
I20260811 11:47:52.185283 6564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:52.211558 6564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:52.215596 6564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:52.215801 6564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:52.216513 6564 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:47:52.217921 6616 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 11:47:52.222685 6564 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 11:47:52.222801 6564 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260811 11:47:52.222892 6564 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 11:47:52.225104 6564 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 11:47:52.225167 6564 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260811 11:47:52.225522 6616 tablet_bootstrap.cc:492] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8: Bootstrap starting.
I20260811 11:47:52.235471 6564 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:34181
I20260811 11:47:52.235914 6747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:34181 every 8 connection(s)
I20260811 11:47:52.236564 6564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:47:52.237313 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 6564
I20260811 11:47:52.237814 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:42363
--local_ip_for_outbound_sockets=127.20.244.66
--tserver_master_addrs=127.20.244.126:40461
--webserver_port=37677
--webserver_interface=127.20.244.66
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:37979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:47:52.247066 6616 log.cc:824] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8: Log is configured to *not* fsync() on all Append() calls
Aug 11 11:47:52 dist-test-slave-vkjp krb5kdc[5791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448872, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:47:52.256028 6616 tablet_bootstrap.cc:492] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:47:52.256438 6616 tablet_bootstrap.cc:492] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8: Bootstrap complete.
I20260811 11:47:52.257512 6752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:52.241006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.65:46875)
0811 11:47:52.241631 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:52.241692 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:52.242548 (+ 856us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:52.243713 (+ 1165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:52.243721 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:52.244172 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:52.244694 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:52.244709 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.246003 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.246006 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:52.246877 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:52.246887 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.247783 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.247789 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:52.248044 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:52.248787 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:52.248814 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:52.251076 (+ 2262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:52.254050 (+ 2974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:52.254057 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:52.254071 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:52.254413 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:52.254827 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:52.254830 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:52.254832 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:52.254999 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:52.255714 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:52.255720 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:52.256032 (+ 312us) client_negotiation.cc:769] Sending connection context
0811 11:47:52.256224 (+ 192us) client_negotiation.cc:240] Negotiation successful
0811 11:47:52.256554 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":198,"threads_started":1}
I20260811 11:47:52.257627 6616 ts_tablet_manager.cc:1397] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8: Time spent bootstrapping tablet: real 0.032s user 0.029s sys 0.000s
I20260811 11:47:52.259243 6751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:52.240974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:46875 (local address 127.20.244.126:40461)
0811 11:47:52.241634 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:52.241654 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:52.241834 (+ 180us) server_negotiation.cc:407] Connection header received
0811 11:47:52.242962 (+ 1128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:52.242972 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:52.243336 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:52.243655 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:52.244868 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.245832 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.247018 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.247605 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.247797 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:52.251338 (+ 3541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:52.251345 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:52.251361 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:52.251397 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:52.253641 (+ 2244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:52.254547 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:52.254557 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:52.254564 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:52.254721 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:52.255128 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:52.255131 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:52.255133 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:52.255591 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:52.255728 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:52.258105 (+ 2377us) server_negotiation.cc:299] Negotiation successful
0811 11:47:52.258404 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":519,"thread_start_us":151,"threads_started":1}
I20260811 11:47:52.260344 6616 raft_consensus.cc:348] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } } peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } }
I20260811 11:47:52.260792 6616 raft_consensus.cc:729] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde1985323994b6d981397f78f0b4ee8, State: Initialized, Role: FOLLOWER
I20260811 11:47:52.261307 6616 consensus_queue.cc:260] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } } peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } }
I20260811 11:47:52.261602 6748 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40461
I20260811 11:47:52.261832 6748 heartbeater.cc:464] Registering TS with master...
I20260811 11:47:52.262346 6748 heartbeater.cc:511] Master 127.20.244.126:40461 requested a full tablet report, sending...
I20260811 11:47:52.262343 6616 ts_tablet_manager.cc:1428] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260811 11:47:52.265107 6516 ts_manager.cc:194] Registered new tserver with Master: bde1985323994b6d981397f78f0b4ee8 (127.20.244.65:34181)
I20260811 11:47:52.269075 6516 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:46875
I20260811 11:47:52.271868 6748 heartbeater.cc:503] Master 127.20.244.126:40461 was elected leader, sending a full tablet report...
Aug 11 11:47:52 dist-test-slave-vkjp krb5kdc[5791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448871, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for kudu/127.20.244.65@KRBTEST.COM
I20260811 11:47:52.279925 6755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:52.268629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:34181 (local address 127.0.0.1:47644)
0811 11:47:52.269427 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:52.269475 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:52.269643 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:52.270210 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:52.270216 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:52.270590 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:52.270698 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:52.270705 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.271761 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.271765 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:52.272612 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:52.272622 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.273368 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.273372 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:52.273483 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:52.274093 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:52.274106 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:52.275664 (+ 1558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:52.277945 (+ 2281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:52.277954 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:52.277960 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:52.278236 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:52.278643 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:52.278646 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:52.278648 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:52.278749 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:52.279331 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:52.279336 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:52.279482 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 11:47:52.279607 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 11:47:52.279776 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":132,"threads_started":1}
I20260811 11:47:52.280115 6756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:52.268697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47644 (local address 127.20.244.65:34181)
0811 11:47:52.269161 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:52.269172 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:52.269579 (+ 407us) server_negotiation.cc:407] Connection header received
0811 11:47:52.269805 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:52.269811 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:52.270038 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:52.270178 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:52.270845 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.271643 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.272737 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.273234 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.273345 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:52.275819 (+ 2474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:52.275830 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:52.275842 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:52.275869 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:52.277797 (+ 1928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:52.278415 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:52.278421 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:52.278423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:52.278524 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:52.278851 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:52.278854 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:52.278856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:52.279195 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:52.279325 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:52.279717 (+ 392us) server_negotiation.cc:299] Negotiation successful
0811 11:47:52.279928 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":365,"thread_start_us":135,"threads_started":1}
I20260811 11:47:52.281427 6666 tablet_service.cc:1514] Processing DeleteTablet for tablet dea5f6667a7a45fc95bda527efdcd73a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:47:51 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:47644
I20260811 11:47:52.282330 6757 tablet_replica.cc:330] stopping tablet replica
I20260811 11:47:52.282663 6757 raft_consensus.cc:2229] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:47:52.282938 6757 raft_consensus.cc:2258] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:47:52.283985 6757 ts_tablet_manager.cc:1905] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:47:52.287794 6757 ts_tablet_manager.cc:1918] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:47:52.287882 6757 log.cc:1196] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/wal/wals/dea5f6667a7a45fc95bda527efdcd73a
I20260811 11:47:52.288163 6757 ts_tablet_manager.cc:1939] T dea5f6667a7a45fc95bda527efdcd73a P bde1985323994b6d981397f78f0b4ee8: Deleting consensus metadata
I20260811 11:47:52.289849 6497 catalog_manager.cc:4841] TS bde1985323994b6d981397f78f0b4ee8 (127.20.244.65:34181): tablet dea5f6667a7a45fc95bda527efdcd73a (table test-table [id=e3ab0181146a4126bb6c9b05aea07f71]) successfully deleted
W20260811 11:47:52.368111 6750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:52.368409 6750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:52.368482 6750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:52.372702 6750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:52.372792 6750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:52.372882 6750 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:47:52.378521 6750 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:42363
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=37677
--tserver_master_addrs=127.20.244.126:40461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6750
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:52.379748 6750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:52.380798 6750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:52.390801 6762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:52.390805 6763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:52.390805 6765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:52.391126 6750 server_base.cc:1034] running on GCE node
I20260811 11:47:52.391680 6750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:52.392362 6750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:52.393561 6750 hybrid_clock.cc:648] HybridClock initialized: now 1786448872393522 us; error 44 us; skew 500 ppm
Aug 11 11:47:52 dist-test-slave-vkjp krb5kdc[5791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448872, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:52.396530 6750 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:47:52.397413 6750 webserver.cc:460] Webserver started at http://127.20.244.66:37677/ using document root <none> and password file <none>
I20260811 11:47:52.397965 6750 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:52.398038 6750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:47:52.402081 6750 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 11:47:52.404433 6776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:52.405809 6750 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 11:47:52.405915 6750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "187e6eea0db54d77a5b250c10bda2aa3"
format_stamp: "Formatted at 2026-08-11 11:47:51 on dist-test-slave-vkjp"
server_key: "38280610d42672be1ee814cc603b1bc2"
server_key_iv: "89c0308fa156074132a1b595a4cdb3d9"
server_key_version: "encryptionkey@0"
I20260811 11:47:52.406455 6750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:52.429158 6750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:52.432816 6750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:52.433000 6750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:52.433712 6750 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:47:52.434602 6750 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:47:52.434654 6750 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:52.434700 6750 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:47:52.434723 6750 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:52.445678 6750 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:42363
I20260811 11:47:52.445731 6913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:42363 every 8 connection(s)
I20260811 11:47:52.446838 6750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:47:52.448097 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 6750
I20260811 11:47:52.448602 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:35419
--local_ip_for_outbound_sockets=127.20.244.67
--tserver_master_addrs=127.20.244.126:40461
--webserver_port=39883
--webserver_interface=127.20.244.67
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:37979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 11:47:52 dist-test-slave-vkjp krb5kdc[5791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448872, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:47:52.464527 6751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:52.449169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:43469 (local address 127.20.244.126:40461)
0811 11:47:52.449399 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:52.449404 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:52.450521 (+ 1117us) server_negotiation.cc:407] Connection header received
0811 11:47:52.452227 (+ 1706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:52.452230 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:52.452287 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:52.452390 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:52.454256 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.454871 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.456851 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.457099 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.457197 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:52.460354 (+ 3157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:52.460358 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:52.460360 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:52.460389 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:52.462041 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:52.462627 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:52.462631 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:52.462632 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:52.462717 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:52.463140 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:52.463144 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:52.463152 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:52.463375 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:52.463525 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:52.464125 (+ 600us) server_negotiation.cc:299] Negotiation successful
0811 11:47:52.464297 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 11:47:52.465498 6919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:52.449735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.66:43469)
0811 11:47:52.450312 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:52.450378 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:52.451910 (+ 1532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:52.452630 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:52.452642 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:52.453247 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:52.454029 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:52.454056 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.455025 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.455030 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:52.456695 (+ 1665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:52.456710 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.457284 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.457291 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:52.457552 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:52.458222 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:52.458248 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:52.460150 (+ 1902us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:52.462184 (+ 2034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:52.462191 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:52.462208 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:52.462499 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:52.462829 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:52.462833 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:52.462835 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:52.462994 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:52.463522 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:52.463530 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:52.463801 (+ 271us) client_negotiation.cc:769] Sending connection context
0811 11:47:52.464052 (+ 251us) client_negotiation.cc:240] Negotiation successful
0811 11:47:52.464415 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":135,"threads_started":1}
I20260811 11:47:52.466915 6915 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40461
I20260811 11:47:52.467236 6915 heartbeater.cc:464] Registering TS with master...
I20260811 11:47:52.467852 6915 heartbeater.cc:511] Master 127.20.244.126:40461 requested a full tablet report, sending...
I20260811 11:47:52.469028 6516 ts_manager.cc:194] Registered new tserver with Master: 187e6eea0db54d77a5b250c10bda2aa3 (127.20.244.66:42363)
I20260811 11:47:52.469785 6516 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:43469
W20260811 11:47:52.568176 6920 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:52.568439 6920 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:52.568482 6920 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:52.572547 6920 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:52.572614 6920 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:52.572674 6920 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:47:52.578066 6920 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:35419
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=39883
--tserver_master_addrs=127.20.244.126:40461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6920
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:52.579180 6920 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:52.580173 6920 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:52.590114 6927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:52.590127 6926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:52.590155 6930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:52.590330 6920 server_base.cc:1034] running on GCE node
I20260811 11:47:52.590871 6920 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:52.591627 6920 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:52.592811 6920 hybrid_clock.cc:648] HybridClock initialized: now 1786448872592800 us; error 30 us; skew 500 ppm
Aug 11 11:47:52 dist-test-slave-vkjp krb5kdc[5791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448872, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:52.595959 6920 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:47:52.596872 6920 webserver.cc:460] Webserver started at http://127.20.244.67:39883/ using document root <none> and password file <none>
I20260811 11:47:52.597437 6920 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:52.597545 6920 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:47:52.601598 6920 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 11:47:52.603756 6938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:52.605052 6920 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 11:47:52.605183 6920 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "2d30217e964f44318106a8946af8790a"
format_stamp: "Formatted at 2026-08-11 11:47:51 on dist-test-slave-vkjp"
server_key: "916efe636ed9686fe0f61a6d7ce8a42c"
server_key_iv: "dfd44761f655a3040417dfcd4dc382f9"
server_key_version: "encryptionkey@0"
I20260811 11:47:52.605785 6920 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:52.628998 6920 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:52.632472 6920 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:52.632683 6920 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:52.633311 6920 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:47:52.634162 6920 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:47:52.634230 6920 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:52.634300 6920 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:47:52.634341 6920 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:52.644322 6920 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:35419
I20260811 11:47:52.644379 7076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:35419 every 8 connection(s)
I20260811 11:47:52.645428 6920 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:47:52.647679 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 6920
Aug 11 11:47:52 dist-test-slave-vkjp krb5kdc[5791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448872, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:47:52.658600 7080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:52.648422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33854 (local address 127.20.244.126:40461)
0811 11:47:52.649095 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:52.649098 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:52.649108 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:47:52.649146 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:52.649148 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:52.649185 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:52.649257 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:52.650398 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.651055 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.652534 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.652771 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.652886 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:52.654313 (+ 1427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:52.654317 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:52.654319 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:52.654341 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:52.656236 (+ 1895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:52.656798 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:52.656801 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:52.656802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:52.656877 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:52.657191 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:52.657194 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:52.657195 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:52.657374 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:52.657536 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:52.658143 (+ 607us) server_negotiation.cc:299] Negotiation successful
0811 11:47:52.658362 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":101,"threads_started":1}
I20260811 11:47:52.661823 6751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:52.647447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:52689 (local address 127.20.244.126:40461)
0811 11:47:52.647589 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:52.647593 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:52.648811 (+ 1218us) server_negotiation.cc:407] Connection header received
0811 11:47:52.650721 (+ 1910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:52.650724 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:52.650770 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:52.650852 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:52.652417 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.652920 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.654287 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.654512 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.654652 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:52.658250 (+ 3598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:52.658254 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:52.658256 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:52.658286 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:52.659951 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:52.660437 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:52.660442 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:52.660443 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:52.660530 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:52.660919 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:52.660921 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:52.660922 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:52.661093 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:52.661167 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:52.661623 (+ 456us) server_negotiation.cc:299] Negotiation successful
0811 11:47:52.661712 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 11:47:52.662704 7079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:52.648038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.67:52689)
0811 11:47:52.648609 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:52.648666 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:52.650519 (+ 1853us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:52.651024 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:52.651031 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:52.651594 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:52.652263 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:52.652279 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.653054 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.653057 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:52.654140 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:52.654151 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.654674 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.654677 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:52.654930 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:52.655688 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:52.655709 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:52.658039 (+ 2330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:52.660045 (+ 2006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:52.660051 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:52.660066 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:52.660330 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:52.660637 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:52.660640 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:52.660643 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:52.660830 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:52.661179 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:52.661184 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:52.661420 (+ 236us) client_negotiation.cc:769] Sending connection context
0811 11:47:52.661578 (+ 158us) client_negotiation.cc:240] Negotiation successful
0811 11:47:52.661851 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":175,"threads_started":1}
I20260811 11:47:52.663852 7077 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40461
I20260811 11:47:52.664122 7077 heartbeater.cc:464] Registering TS with master...
I20260811 11:47:52.664633 7077 heartbeater.cc:511] Master 127.20.244.126:40461 requested a full tablet report, sending...
I20260811 11:47:52.665673 6516 ts_manager.cc:194] Registered new tserver with Master: 2d30217e964f44318106a8946af8790a (127.20.244.67:35419)
I20260811 11:47:52.666286 6516 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:52689
I20260811 11:47:52.672618 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:47:52.677213 6751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:52.673265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33858 (local address 127.20.244.126:40461)
0811 11:47:52.673385 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:52.673389 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:52.673644 (+ 255us) server_negotiation.cc:407] Connection header received
0811 11:47:52.673830 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:52.673833 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:52.673934 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:52.674043 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:47:52.674283 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.674805 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.675781 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.676002 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.676114 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:52.676430 (+ 316us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:47:52.676820 (+ 390us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:47:52.676951 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:52.677020 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 11:47:52.677074 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 11:47:52.677886 6516 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:33858:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:47:52.681504 6516 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:47:52.689488 6666 tablet_service.cc:1467] Processing CreateTablet for tablet c24c2df4758b43bb96520162865bfd6e (DEFAULT_TABLE table=test-table [id=a0545722e7e246c7ab15e9f1efe9a8f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:47:52.690251 6666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c24c2df4758b43bb96520162865bfd6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:47:52.693216 6616 tablet_bootstrap.cc:492] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8: Bootstrap starting.
I20260811 11:47:52.693562 6755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:52.688288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:35419 (local address 127.0.0.1:54886)
0811 11:47:52.688459 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:52.688475 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:52.688556 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:52.689459 (+ 903us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:52.689462 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:52.689483 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:47:52.689600 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:52.689607 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.691168 (+ 1561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.691173 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:52.692033 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:52.692042 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.693078 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.693082 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:52.693191 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:52.693248 (+ 57us) client_negotiation.cc:769] Sending connection context
0811 11:47:52.693346 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 11:47:52.693435 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101}
I20260811 11:47:52.694198 6616 tablet_bootstrap.cc:654] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8: Neither blocks nor log segments found. Creating new log.
I20260811 11:47:52.694350 7091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:52.688515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54886 (local address 127.20.244.67:35419)
0811 11:47:52.688930 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:52.688939 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:52.688960 (+ 21us) server_negotiation.cc:407] Connection header received
0811 11:47:52.689048 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:52.689055 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:52.689285 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:52.689473 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:47:52.689830 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.690987 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.692156 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.692940 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.693050 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:52.693198 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:52.694051 (+ 853us) server_negotiation.cc:299] Negotiation successful
0811 11:47:52.694180 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":188,"threads_started":1}
I20260811 11:47:52.695551 7092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:52.689070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:42363 (local address 127.0.0.1:45038)
0811 11:47:52.689905 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:52.689919 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:52.690024 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:52.690626 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:52.690629 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:52.690647 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:47:52.690734 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:52.690739 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.692444 (+ 1705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.692447 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:52.693773 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:52.693787 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.694975 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.694978 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:52.695064 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:52.695112 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 11:47:52.695353 (+ 241us) client_negotiation.cc:240] Negotiation successful
0811 11:47:52.695444 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":755,"thread_start_us":108,"threads_started":1}
I20260811 11:47:52.695964 7093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:52.689245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45038 (local address 127.20.244.66:42363)
0811 11:47:52.689749 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:52.689761 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:52.690026 (+ 265us) server_negotiation.cc:407] Connection header received
0811 11:47:52.690181 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:52.690187 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:52.690384 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:52.690535 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:47:52.691219 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.692284 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.693922 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.694824 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.694977 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:52.695146 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:52.695748 (+ 602us) server_negotiation.cc:299] Negotiation successful
0811 11:47:52.695833 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":123,"threads_started":1}
I20260811 11:47:52.697535 6995 tablet_service.cc:1467] Processing CreateTablet for tablet c24c2df4758b43bb96520162865bfd6e (DEFAULT_TABLE table=test-table [id=a0545722e7e246c7ab15e9f1efe9a8f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:47:52.698741 6995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c24c2df4758b43bb96520162865bfd6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:47:52.698684 6832 tablet_service.cc:1467] Processing CreateTablet for tablet c24c2df4758b43bb96520162865bfd6e (DEFAULT_TABLE table=test-table [id=a0545722e7e246c7ab15e9f1efe9a8f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:47:52.699772 6832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c24c2df4758b43bb96520162865bfd6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:47:52.699975 6616 tablet_bootstrap.cc:492] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8: No bootstrap required, opened a new log
I20260811 11:47:52.700089 6616 ts_tablet_manager.cc:1397] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260811 11:47:52.700515 6616 raft_consensus.cc:348] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } } peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } }
I20260811 11:47:52.700640 6616 raft_consensus.cc:374] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:47:52.700688 6616 raft_consensus.cc:729] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde1985323994b6d981397f78f0b4ee8, State: Initialized, Role: FOLLOWER
I20260811 11:47:52.700846 6616 consensus_queue.cc:260] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } } peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } }
I20260811 11:47:52.701223 6616 ts_tablet_manager.cc:1428] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:47:52.707453 7096 tablet_bootstrap.cc:492] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a: Bootstrap starting.
I20260811 11:47:52.707798 7095 tablet_bootstrap.cc:492] T c24c2df4758b43bb96520162865bfd6e P 187e6eea0db54d77a5b250c10bda2aa3: Bootstrap starting.
I20260811 11:47:52.710309 7095 tablet_bootstrap.cc:654] T c24c2df4758b43bb96520162865bfd6e P 187e6eea0db54d77a5b250c10bda2aa3: Neither blocks nor log segments found. Creating new log.
I20260811 11:47:52.711054 7095 log.cc:824] T c24c2df4758b43bb96520162865bfd6e P 187e6eea0db54d77a5b250c10bda2aa3: Log is configured to *not* fsync() on all Append() calls
I20260811 11:47:52.712422 7096 tablet_bootstrap.cc:654] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a: Neither blocks nor log segments found. Creating new log.
I20260811 11:47:52.713157 7096 log.cc:824] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a: Log is configured to *not* fsync() on all Append() calls
I20260811 11:47:52.713188 7095 tablet_bootstrap.cc:492] T c24c2df4758b43bb96520162865bfd6e P 187e6eea0db54d77a5b250c10bda2aa3: No bootstrap required, opened a new log
I20260811 11:47:52.713392 7095 ts_tablet_manager.cc:1397] T c24c2df4758b43bb96520162865bfd6e P 187e6eea0db54d77a5b250c10bda2aa3: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 11:47:52.714943 7096 tablet_bootstrap.cc:492] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a: No bootstrap required, opened a new log
I20260811 11:47:52.715189 7096 ts_tablet_manager.cc:1397] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260811 11:47:52.716600 7095 raft_consensus.cc:348] T c24c2df4758b43bb96520162865bfd6e P 187e6eea0db54d77a5b250c10bda2aa3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } } peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } }
I20260811 11:47:52.716842 7095 raft_consensus.cc:374] T c24c2df4758b43bb96520162865bfd6e P 187e6eea0db54d77a5b250c10bda2aa3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:47:52.716898 7095 raft_consensus.cc:729] T c24c2df4758b43bb96520162865bfd6e P 187e6eea0db54d77a5b250c10bda2aa3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 187e6eea0db54d77a5b250c10bda2aa3, State: Initialized, Role: FOLLOWER
I20260811 11:47:52.717293 7095 consensus_queue.cc:260] T c24c2df4758b43bb96520162865bfd6e P 187e6eea0db54d77a5b250c10bda2aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } } peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } }
I20260811 11:47:52.718075 6915 heartbeater.cc:503] Master 127.20.244.126:40461 was elected leader, sending a full tablet report...
I20260811 11:47:52.718353 7095 ts_tablet_manager.cc:1428] T c24c2df4758b43bb96520162865bfd6e P 187e6eea0db54d77a5b250c10bda2aa3: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 11:47:52.718477 7096 raft_consensus.cc:348] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } } peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } }
I20260811 11:47:52.718703 7096 raft_consensus.cc:374] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:47:52.718745 7096 raft_consensus.cc:729] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d30217e964f44318106a8946af8790a, State: Initialized, Role: FOLLOWER
I20260811 11:47:52.719172 7096 consensus_queue.cc:260] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } } peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } }
I20260811 11:47:52.719892 7077 heartbeater.cc:503] Master 127.20.244.126:40461 was elected leader, sending a full tablet report...
I20260811 11:47:52.720255 7096 ts_tablet_manager.cc:1428] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
W20260811 11:47:52.738142 6749 tablet.cc:2369] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:47:52.755470 7100 raft_consensus.cc:482] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:47:52.755676 7100 raft_consensus.cc:504] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } } peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } }
I20260811 11:47:52.756837 7100 leader_election.cc:288] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 187e6eea0db54d77a5b250c10bda2aa3 (127.20.244.66:42363), bde1985323994b6d981397f78f0b4ee8 (127.20.244.65:34181)
I20260811 11:47:52.761917 7093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:52.757495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:42925 (local address 127.20.244.66:42363)
0811 11:47:52.757620 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:52.757625 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:52.757638 (+ 13us) server_negotiation.cc:407] Connection header received
0811 11:47:52.757691 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:52.757694 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:52.757748 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:52.757853 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:47:52.758097 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.758890 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.760550 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.761157 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.761304 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:52.761359 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:52.761702 (+ 343us) server_negotiation.cc:299] Negotiation successful
0811 11:47:52.761782 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 11:47:52.761917 6756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:52.757316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:50913 (local address 127.20.244.65:34181)
0811 11:47:52.757448 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:52.757453 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:52.757749 (+ 296us) server_negotiation.cc:407] Connection header received
0811 11:47:52.757916 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:52.757919 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:52.757987 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:52.758096 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:47:52.758332 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.759072 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.760550 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.761230 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.761334 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:52.761490 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:52.761713 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 11:47:52.761782 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 11:47:52.761951 7079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:52.757050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:42363 (local address 127.20.244.67:42925)
0811 11:47:52.757229 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:52.757245 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:52.757344 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:52.757848 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:52.757851 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:52.757868 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:47:52.757987 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:52.757992 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.759008 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.759011 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:52.760404 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:52.760417 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.761348 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.761352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:52.761563 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:52.761585 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 11:47:52.761677 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 11:47:52.761800 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"mutex_wait_us":58}
I20260811 11:47:52.762308 7101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:52.757084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:34181 (local address 127.20.244.67:50913)
0811 11:47:52.757638 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:52.757652 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:52.757774 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:52.758117 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:52.758120 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:52.758135 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:47:52.758223 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:52.758227 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.759206 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.759209 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:52.760411 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:52.760417 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.761348 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.761352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:52.761558 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:52.761590 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 11:47:52.761677 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 11:47:52.762021 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"mutex_wait_us":296,"thread_start_us":148,"threads_started":1}
I20260811 11:47:52.762645 6858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c24c2df4758b43bb96520162865bfd6e" candidate_uuid: "2d30217e964f44318106a8946af8790a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "187e6eea0db54d77a5b250c10bda2aa3" is_pre_election: true
I20260811 11:47:52.762967 6858 raft_consensus.cc:2454] T c24c2df4758b43bb96520162865bfd6e P 187e6eea0db54d77a5b250c10bda2aa3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d30217e964f44318106a8946af8790a in term 0.
I20260811 11:47:52.762928 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c24c2df4758b43bb96520162865bfd6e" candidate_uuid: "2d30217e964f44318106a8946af8790a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde1985323994b6d981397f78f0b4ee8" is_pre_election: true
I20260811 11:47:52.763243 6692 raft_consensus.cc:2454] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d30217e964f44318106a8946af8790a in term 0.
I20260811 11:47:52.763465 6941 leader_election.cc:302] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 187e6eea0db54d77a5b250c10bda2aa3, 2d30217e964f44318106a8946af8790a; no voters:
I20260811 11:47:52.763775 7100 raft_consensus.cc:2781] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:47:52.763851 7100 raft_consensus.cc:482] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:47:52.763900 7100 raft_consensus.cc:3037] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:47:52.765079 7100 raft_consensus.cc:504] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } } peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } }
I20260811 11:47:52.765455 7100 leader_election.cc:288] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a [CANDIDATE]: Term 1 election: Requested vote from peers 187e6eea0db54d77a5b250c10bda2aa3 (127.20.244.66:42363), bde1985323994b6d981397f78f0b4ee8 (127.20.244.65:34181)
I20260811 11:47:52.765805 6858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c24c2df4758b43bb96520162865bfd6e" candidate_uuid: "2d30217e964f44318106a8946af8790a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "187e6eea0db54d77a5b250c10bda2aa3"
I20260811 11:47:52.765812 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c24c2df4758b43bb96520162865bfd6e" candidate_uuid: "2d30217e964f44318106a8946af8790a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bde1985323994b6d981397f78f0b4ee8"
I20260811 11:47:52.765913 6858 raft_consensus.cc:3037] T c24c2df4758b43bb96520162865bfd6e P 187e6eea0db54d77a5b250c10bda2aa3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:47:52.765952 6692 raft_consensus.cc:3037] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:47:52.767064 6692 raft_consensus.cc:2454] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d30217e964f44318106a8946af8790a in term 1.
I20260811 11:47:52.767194 6858 raft_consensus.cc:2454] T c24c2df4758b43bb96520162865bfd6e P 187e6eea0db54d77a5b250c10bda2aa3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d30217e964f44318106a8946af8790a in term 1.
I20260811 11:47:52.767493 6942 leader_election.cc:302] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d30217e964f44318106a8946af8790a, bde1985323994b6d981397f78f0b4ee8; no voters:
I20260811 11:47:52.767714 7100 raft_consensus.cc:2781] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:47:52.767980 7100 raft_consensus.cc:686] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a [term 1 LEADER]: Becoming Leader. State: Replica: 2d30217e964f44318106a8946af8790a, State: Running, Role: LEADER
I20260811 11:47:52.768366 7100 consensus_queue.cc:237] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } } peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } }
I20260811 11:47:52.771642 6515 catalog_manager.cc:5495] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d30217e964f44318106a8946af8790a (127.20.244.67). New cstate: current_term: 1 leader_uuid: "2d30217e964f44318106a8946af8790a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } health_report { overall_health: UNKNOWN } } }
I20260811 11:47:52.800933 7091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:52.797359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54892 (local address 127.20.244.67:35419)
0811 11:47:52.797509 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:52.797513 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:52.797527 (+ 14us) server_negotiation.cc:407] Connection header received
0811 11:47:52.797658 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:52.797660 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:52.797713 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:52.797815 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:47:52.798083 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.798576 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.799534 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:52.799742 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:52.799821 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:52.800102 (+ 281us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:47:52.800581 (+ 479us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:47:52.800675 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:52.800750 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 11:47:52.800800 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 11:47:52.806955 6692 raft_consensus.cc:1261] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Refusing update from remote peer 2d30217e964f44318106a8946af8790a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:47:52.806959 6858 raft_consensus.cc:1261] T c24c2df4758b43bb96520162865bfd6e P 187e6eea0db54d77a5b250c10bda2aa3 [term 1 FOLLOWER]: Refusing update from remote peer 2d30217e964f44318106a8946af8790a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:47:52.807713 7100 consensus_queue.cc:1035] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a [LEADER]: Connected to new peer: Peer: permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:47:52.807951 7102 consensus_queue.cc:1035] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:47:52.814872 7105 mvcc.cc:205] Tried to move back new op lower bound from 7317294583010095104 to 7317294582862225408. Current Snapshot: MvccSnapshot[applied={T|T < 7317294583010095104}]
I20260811 11:47:52.815882 7104 mvcc.cc:205] Tried to move back new op lower bound from 7317294583010095104 to 7317294582862225408. Current Snapshot: MvccSnapshot[applied={T|T < 7317294583010095104}]
I20260811 11:47:52.825227 6515 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:33858:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:47:52.825385 6515 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:33858:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:47:52.827930 6515 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a: Sending DeleteTablet for 3 replicas of tablet c24c2df4758b43bb96520162865bfd6e
I20260811 11:47:52.828675 6995 tablet_service.cc:1514] Processing DeleteTablet for tablet c24c2df4758b43bb96520162865bfd6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:47:52 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:54886
I20260811 11:47:52.828828 6666 tablet_service.cc:1514] Processing DeleteTablet for tablet c24c2df4758b43bb96520162865bfd6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:47:52 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:47644
I20260811 11:47:52.828997 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 6564
I20260811 11:47:52.828931 6832 tablet_service.cc:1514] Processing DeleteTablet for tablet c24c2df4758b43bb96520162865bfd6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:47:52 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:45038
I20260811 11:47:52.833077 7116 tablet_replica.cc:330] T c24c2df4758b43bb96520162865bfd6e P 187e6eea0db54d77a5b250c10bda2aa3: stopping tablet replica
I20260811 11:47:52.833542 7116 raft_consensus.cc:2229] T c24c2df4758b43bb96520162865bfd6e P 187e6eea0db54d77a5b250c10bda2aa3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:47:52.833984 7116 raft_consensus.cc:2258] T c24c2df4758b43bb96520162865bfd6e P 187e6eea0db54d77a5b250c10bda2aa3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:47:52.836186 7116 ts_tablet_manager.cc:1905] T c24c2df4758b43bb96520162865bfd6e P 187e6eea0db54d77a5b250c10bda2aa3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:47:52.837689 7114 tablet_replica.cc:330] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a: stopping tablet replica
I20260811 11:47:52.838028 7114 raft_consensus.cc:2229] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:47:52.838428 7114 raft_consensus.cc:2258] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:47:52.839529 7116 ts_tablet_manager.cc:1918] T c24c2df4758b43bb96520162865bfd6e P 187e6eea0db54d77a5b250c10bda2aa3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:47:52.839643 7116 log.cc:1196] T c24c2df4758b43bb96520162865bfd6e P 187e6eea0db54d77a5b250c10bda2aa3: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/c24c2df4758b43bb96520162865bfd6e
I20260811 11:47:52.840003 7116 ts_tablet_manager.cc:1939] T c24c2df4758b43bb96520162865bfd6e P 187e6eea0db54d77a5b250c10bda2aa3: Deleting consensus metadata
I20260811 11:47:52.840328 7114 ts_tablet_manager.cc:1905] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:47:52.841302 6496 catalog_manager.cc:4841] TS 187e6eea0db54d77a5b250c10bda2aa3 (127.20.244.66:42363): tablet c24c2df4758b43bb96520162865bfd6e (table test-table [id=a0545722e7e246c7ab15e9f1efe9a8f4]) successfully deleted
I20260811 11:47:52.843849 7114 ts_tablet_manager.cc:1918] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:47:52.843958 7114 log.cc:1196] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/c24c2df4758b43bb96520162865bfd6e
I20260811 11:47:52.844316 7114 ts_tablet_manager.cc:1939] T c24c2df4758b43bb96520162865bfd6e P 2d30217e964f44318106a8946af8790a: Deleting consensus metadata
I20260811 11:47:52.845577 6494 catalog_manager.cc:4841] TS 2d30217e964f44318106a8946af8790a (127.20.244.67:35419): tablet c24c2df4758b43bb96520162865bfd6e (table test-table [id=a0545722e7e246c7ab15e9f1efe9a8f4]) successfully deleted
W20260811 11:47:52.846143 6497 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.244.65:34181 (error 108)
I20260811 11:47:52.846740 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 6750
I20260811 11:47:52.849509 7092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:52.846962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:34181 (local address 127.0.0.1:47660)
0811 11:47:52.849332 (+ 2370us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:52.849412 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.65:34181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2265}
W20260811 11:47:52.851266 6497 catalog_manager.cc:4584] TS bde1985323994b6d981397f78f0b4ee8 (127.20.244.65:34181): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c24c2df4758b43bb96520162865bfd6e: Network error: Client connection negotiation failed: client connection to 127.20.244.65:34181: connect: Connection refused (error 111)
I20260811 11:47:52.856817 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 6920
I20260811 11:47:52.866777 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 6471
I20260811 11:47:52.877422 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:40461
--webserver_interface=127.20.244.126
--webserver_port=35171
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:37979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:40461
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:47:52.998023 7118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:52.998358 7118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:52.998405 7118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:53.002796 7118 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:47:53.002873 7118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:53.002893 7118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:53.002910 7118 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:47:53.002925 7118 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:47:53.008472 7118 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:40461
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:40461
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=35171
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7118
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:53.009586 7118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:53.010811 7118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:53.020005 7127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:53.020015 7129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:53.019999 7125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:53.020066 7118 server_base.cc:1034] running on GCE node
I20260811 11:47:53.021106 7118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:53.022351 7118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:53.023525 7118 hybrid_clock.cc:648] HybridClock initialized: now 1786448873023503 us; error 36 us; skew 500 ppm
Aug 11 11:47:53 dist-test-slave-vkjp krb5kdc[5791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448873, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:53.026573 7118 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:47:53.027627 7118 webserver.cc:460] Webserver started at http://127.20.244.126:35171/ using document root <none> and password file <none>
I20260811 11:47:53.028208 7118 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:53.028272 7118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:47:53.032311 7118 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 11:47:53.034772 7136 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:53.036109 7118 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:47:53.036245 7118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "0c57b719ce0740d39b2ee894d0a25c1a"
format_stamp: "Formatted at 2026-08-11 11:47:50 on dist-test-slave-vkjp"
server_key: "d8aa978675c0ae872e694be973a8794d"
server_key_iv: "9d12a0a35463461edf432193660dd63f"
server_key_version: "encryptionkey@0"
I20260811 11:47:53.036828 7118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:53.065853 7118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:53.069271 7118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:53.069490 7118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:53.078299 7118 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:40461
I20260811 11:47:53.078651 7201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:40461 every 8 connection(s)
I20260811 11:47:53.079556 7118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:47:53.083968 7202 sys_catalog.cc:263] Verifying existing consensus state
I20260811 11:47:53.085250 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 7118
I20260811 11:47:53.085696 7202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a: Bootstrap starting.
I20260811 11:47:53.085724 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:34181
--local_ip_for_outbound_sockets=127.20.244.65
--tserver_master_addrs=127.20.244.126:40461
--webserver_port=42299
--webserver_interface=127.20.244.65
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:37979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:47:53.104192 7202 log.cc:824] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a: Log is configured to *not* fsync() on all Append() calls
I20260811 11:47:53.116050 7202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:47:53.116560 7202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a: Bootstrap complete.
I20260811 11:47:53.121001 7202 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40461 } }
I20260811 11:47:53.121426 7202 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c57b719ce0740d39b2ee894d0a25c1a, State: Initialized, Role: FOLLOWER
I20260811 11:47:53.121925 7202 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40461 } }
I20260811 11:47:53.122051 7202 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:47:53.122139 7202 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:47:53.122251 7202 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 2 FOLLOWER]: Advancing to term 3
I20260811 11:47:53.124495 7202 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40461 } }
I20260811 11:47:53.124853 7202 leader_election.cc:302] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c57b719ce0740d39b2ee894d0a25c1a; no voters:
I20260811 11:47:53.125175 7202 leader_election.cc:288] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 11:47:53.125324 7207 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 3 FOLLOWER]: Leader election won for term 3
I20260811 11:47:53.125579 7207 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [term 3 LEADER]: Becoming Leader. State: Replica: 0c57b719ce0740d39b2ee894d0a25c1a, State: Running, Role: LEADER
I20260811 11:47:53.125907 7207 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40461 } }
I20260811 11:47:53.126482 7202 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:47:53.127458 7209 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40461 } } }
I20260811 11:47:53.127605 7209 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [sys.catalog]: This master's current role is: LEADER
I20260811 11:47:53.127876 7210 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c57b719ce0740d39b2ee894d0a25c1a. Latest consensus state: current_term: 3 leader_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c57b719ce0740d39b2ee894d0a25c1a" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40461 } } }
I20260811 11:47:53.127955 7210 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a [sys.catalog]: This master's current role is: LEADER
I20260811 11:47:53.131916 7225 catalog_manager.cc:1259] Loaded cluster ID: fa2681496d9d43fd87ea7b7f8d22cf43
I20260811 11:47:53.131987 7225 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a: loading cluster ID for follower catalog manager: success
W20260811 11:47:53.133379 7225 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 0c57b719ce0740d39b2ee894d0a25c1a: acquiring CA information for follower catalog manager: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
W20260811 11:47:53.133478 7225 catalog_manager.cc:873] Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO: failed to prepare follower catalog manager, will retry
I20260811 11:47:53.133572 7218 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:47:53.136756 7218 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:47:53.137301 7218 catalog_manager.cc:1259] Loaded cluster ID: fa2681496d9d43fd87ea7b7f8d22cf43
I20260811 11:47:53.137363 7218 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 11:47:53.138082 7218 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f0d201da9ad google::LogMessage::Fail() at ??:0
@ 0x7f0d201dd88a google::LogMessage::SendToLog() at ??:0
@ 0x7f0d201da4de google::LogMessage::Flush() at ??:0
@ 0x7f0d201dba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f0d2ab19fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f0d2ab1ad2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f0d2ab17579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f0d2ab5b640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f0d2242c3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f0d2242cc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f0d2242e3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f0d2241d512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f0d23a616db start_thread at ??:0
@ 0x7f0d1ecd861f clone at ??:0
W20260811 11:47:53.234227 7205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:53.234567 7205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:53.234679 7205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:53.239573 7205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:53.239665 7205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:53.239777 7205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:47:53.245958 7205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:34181
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=42299
--tserver_master_addrs=127.20.244.126:40461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:53.247268 7205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:53.248349 7205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:53.259831 7249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:53.259878 7250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:53.260134 7205 server_base.cc:1034] running on GCE node
W20260811 11:47:53.259832 7252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:53.260762 7205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:53.261492 7205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:53.262715 7205 hybrid_clock.cc:648] HybridClock initialized: now 1786448873262660 us; error 56 us; skew 500 ppm
Aug 11 11:47:53 dist-test-slave-vkjp krb5kdc[5791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448873, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:53.265681 7205 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:47:53.266692 7205 webserver.cc:460] Webserver started at http://127.20.244.65:42299/ using document root <none> and password file <none>
I20260811 11:47:53.267371 7205 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:53.267463 7205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:47:53.271607 7205 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 11:47:53.273967 7262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:53.275504 7205 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:47:53.275652 7205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "bde1985323994b6d981397f78f0b4ee8"
format_stamp: "Formatted at 2026-08-11 11:47:50 on dist-test-slave-vkjp"
server_key: "7cd3473bf1040af3b82b558cc07e317c"
server_key_iv: "c9591606e8536a6500487b3e64ae5dfa"
server_key_version: "encryptionkey@0"
I20260811 11:47:53.276435 7205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:53.293167 7205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:53.296846 7205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:53.297084 7205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:53.298002 7205 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:47:53.299338 7269 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 11:47:53.305771 7205 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 11:47:53.305877 7205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260811 11:47:53.305972 7205 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 11:47:53.308701 7205 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 11:47:53.308771 7205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.001s sys 0.000s
I20260811 11:47:53.310433 7269 tablet_bootstrap.cc:492] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8: Bootstrap starting.
I20260811 11:47:53.322654 7205 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:34181
I20260811 11:47:53.323714 7392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:34181 every 8 connection(s)
I20260811 11:47:53.325044 7205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:47:53.334242 7269 log.cc:824] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8: Log is configured to *not* fsync() on all Append() calls
I20260811 11:47:53.334668 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 7205
I20260811 11:47:53.335228 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:42363
--local_ip_for_outbound_sockets=127.20.244.66
--tserver_master_addrs=127.20.244.126:40461
--webserver_port=37677
--webserver_interface=127.20.244.66
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:37979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:47:53.357002 7269 tablet_bootstrap.cc:492] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:47:53.357615 7269 tablet_bootstrap.cc:492] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8: Bootstrap complete.
I20260811 11:47:53.359211 7269 ts_tablet_manager.cc:1397] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8: Time spent bootstrapping tablet: real 0.050s user 0.017s sys 0.017s
I20260811 11:47:53.362819 7269 raft_consensus.cc:348] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } } peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } }
I20260811 11:47:53.371222 7269 raft_consensus.cc:729] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde1985323994b6d981397f78f0b4ee8, State: Initialized, Role: FOLLOWER
I20260811 11:47:53.371906 7269 consensus_queue.cc:260] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } } peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } }
I20260811 11:47:53.373080 7269 ts_tablet_manager.cc:1428] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
W20260811 11:47:53.394784 7396 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:47:53.327461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.65:53885)
0811 11:47:53.328039 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:53.328096 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:53.328935 (+ 839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:53.394008 (+ 65073us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":196,"threads_started":1}
W20260811 11:47:53.395466 7393 heartbeater.cc:644] Failed to heartbeat to 127.20.244.126:40461 (0 consecutive failures): Network error: Failed to ping master at 127.20.244.126:40461: Client connection negotiation failed: client connection to 127.20.244.126:40461: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 11:47:53.396232 7396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:53.395971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.65:52041)
0811 11:47:53.396103 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:53.396177 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 11:47:53.396975 7396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:53.396717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.65:50553)
0811 11:47:53.396857 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:53.396915 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260811 11:47:53.397203 7393 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 11:47:53.478824 7400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:53.479189 7400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:53.479271 7400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:53.483553 7400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:53.483629 7400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:53.483690 7400 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:47:53.489236 7400 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:42363
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=37677
--tserver_master_addrs=127.20.244.126:40461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7400
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:53.490382 7400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:53.491488 7400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:53.501528 7411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:53.501621 7400 server_base.cc:1034] running on GCE node
W20260811 11:47:53.501528 7407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:53.501554 7409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:53.502285 7400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:53.502978 7400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:53.504154 7400 hybrid_clock.cc:648] HybridClock initialized: now 1786448873504123 us; error 45 us; skew 500 ppm
Aug 11 11:47:53 dist-test-slave-vkjp krb5kdc[5791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448873, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:53.506862 7400 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:47:53.507871 7400 webserver.cc:460] Webserver started at http://127.20.244.66:37677/ using document root <none> and password file <none>
I20260811 11:47:53.508458 7400 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:53.508549 7400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:47:53.512499 7400 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 11:47:53.514627 7418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:53.516005 7400 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:47:53.516139 7400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "187e6eea0db54d77a5b250c10bda2aa3"
format_stamp: "Formatted at 2026-08-11 11:47:51 on dist-test-slave-vkjp"
server_key: "38280610d42672be1ee814cc603b1bc2"
server_key_iv: "89c0308fa156074132a1b595a4cdb3d9"
server_key_version: "encryptionkey@0"
I20260811 11:47:53.516710 7400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:53.534402 7400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:53.537477 7400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:53.537684 7400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:53.538345 7400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:47:53.539254 7400 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:47:53.539320 7400 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:53.539389 7400 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:47:53.539430 7400 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:53.548897 7400 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:42363
I20260811 11:47:53.548913 7554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:42363 every 8 connection(s)
I20260811 11:47:53.549940 7400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:47:53.554184 7557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:53.552277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.66:57261)
0811 11:47:53.552741 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:53.552862 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":127,"threads_started":1}
W20260811 11:47:53.554620 7555 heartbeater.cc:644] Failed to heartbeat to 127.20.244.126:40461 (0 consecutive failures): Network error: Failed to ping master at 127.20.244.126:40461: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
I20260811 11:47:53.555241 7557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:53.555003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.66:47529)
0811 11:47:53.555137 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:53.555190 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 11:47:53.555812 7557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:53.555614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.66:55127)
0811 11:47:53.555717 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:53.555761 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 11:47:53.555980 7555 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 11:47:53.559648 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 7400
I20260811 11:47:53.560052 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:35419
--local_ip_for_outbound_sockets=127.20.244.67
--tserver_master_addrs=127.20.244.126:40461
--webserver_port=39883
--webserver_interface=127.20.244.67
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:37979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:47:53.681619 7558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:47:53.681893 7558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:47:53.681937 7558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:47:53.685945 7558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:47:53.686012 7558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:47:53.686070 7558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:47:53.691401 7558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:35419
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=39883
--tserver_master_addrs=127.20.244.126:40461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:47:53.692471 7558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:47:53.693470 7558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:47:53.703493 7566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:53.703573 7558 server_base.cc:1034] running on GCE node
W20260811 11:47:53.703498 7568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:47:53.703487 7565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:47:53.704154 7558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:47:53.704823 7558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:47:53.706012 7558 hybrid_clock.cc:648] HybridClock initialized: now 1786448873705994 us; error 28 us; skew 500 ppm
Aug 11 11:47:53 dist-test-slave-vkjp krb5kdc[5791](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448873, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:47:53.708871 7558 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:47:53.709828 7558 webserver.cc:460] Webserver started at http://127.20.244.67:39883/ using document root <none> and password file <none>
I20260811 11:47:53.710402 7558 fs_manager.cc:359] Metadata directory not provided
I20260811 11:47:53.710464 7558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:47:53.714543 7558 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 11:47:53.717140 7575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:53.718542 7558 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 11:47:53.718668 7558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "2d30217e964f44318106a8946af8790a"
format_stamp: "Formatted at 2026-08-11 11:47:51 on dist-test-slave-vkjp"
server_key: "916efe636ed9686fe0f61a6d7ce8a42c"
server_key_iv: "dfd44761f655a3040417dfcd4dc382f9"
server_key_version: "encryptionkey@0"
I20260811 11:47:53.719324 7558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:47:53.736660 7558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:47:53.740970 7558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:47:53.741166 7558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:47:53.741765 7558 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:47:53.742630 7558 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:47:53.742681 7558 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:53.742722 7558 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:47:53.742736 7558 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:47:53.752811 7558 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:35419
I20260811 11:47:53.752880 7707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:35419 every 8 connection(s)
I20260811 11:47:53.754033 7558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:47:53.757853 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 7558
I20260811 11:47:53.758194 7710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:53.756369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.67:44653)
0811 11:47:53.756857 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:53.757314 (+ 457us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":117,"threads_started":1}
W20260811 11:47:53.758683 7708 heartbeater.cc:644] Failed to heartbeat to 127.20.244.126:40461 (0 consecutive failures): Network error: Failed to ping master at 127.20.244.126:40461: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
I20260811 11:47:53.759394 7710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:53.759151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.67:54607)
0811 11:47:53.759263 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:53.759309 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 11:47:53.760062 7710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:53.759845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.67:55185)
0811 11:47:53.759960 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:53.760014 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 11:47:53.760238 7708 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 11:47:54.398455 7713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:54.397888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.65:33829)
0811 11:47:54.398229 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:54.398304 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":82,"threads_started":1}
I20260811 11:47:54.557003 7714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:54.556572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.66:33809)
0811 11:47:54.556824 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:54.556890 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":75,"threads_started":1}
I20260811 11:47:54.761312 7715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:54.760843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.67:40201)
0811 11:47:54.761139 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:54.761199 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":93,"threads_started":1}
I20260811 11:47:55.170745 7716 raft_consensus.cc:482] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:47:55.170998 7716 raft_consensus.cc:504] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } } peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } }
I20260811 11:47:55.172221 7716 leader_election.cc:288] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d30217e964f44318106a8946af8790a (127.20.244.67:35419), 187e6eea0db54d77a5b250c10bda2aa3 (127.20.244.66:42363)
Aug 11 11:47:55 dist-test-slave-vkjp krb5kdc[5791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448873, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.67@KRBTEST.COM
Aug 11 11:47:55 dist-test-slave-vkjp krb5kdc[5791](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448873, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.66@KRBTEST.COM
I20260811 11:47:55.187590 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:55.172710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:54223 (local address 127.20.244.66:42363)
0811 11:47:55.173186 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:55.173198 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:55.173233 (+ 35us) server_negotiation.cc:407] Connection header received
0811 11:47:55.173940 (+ 707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:55.173947 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:55.174306 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:55.174916 (+ 610us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:55.175934 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:55.176985 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:55.178195 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:55.178694 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:55.178892 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:55.182496 (+ 3604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:55.182505 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:55.182524 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:55.182565 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:55.184703 (+ 2138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:55.185213 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:55.185219 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:55.185225 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:55.185410 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:55.185809 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:55.185812 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:55.185813 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:55.186323 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:55.186441 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:55.187128 (+ 687us) server_negotiation.cc:299] Negotiation successful
0811 11:47:55.187397 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":86,"threads_started":1}
I20260811 11:47:55.187585 7719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:55.172506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:42363 (local address 127.20.244.65:54223)
0811 11:47:55.172846 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:55.172861 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:55.172948 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:55.174730 (+ 1782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:55.174733 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:55.175362 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:55.175751 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:55.175766 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:55.177132 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:55.177135 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:55.178058 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:55.178068 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:55.178835 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:55.178839 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:55.179118 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:55.179931 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:55.179944 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:55.182286 (+ 2342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:55.184841 (+ 2555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:55.184844 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:55.184847 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:55.185113 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:55.185532 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:55.185535 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:55.185536 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:55.185693 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:55.186448 (+ 755us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:55.186455 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:55.186741 (+ 286us) client_negotiation.cc:769] Sending connection context
0811 11:47:55.186972 (+ 231us) client_negotiation.cc:240] Negotiation successful
0811 11:47:55.187368 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"mutex_wait_us":115,"spinlock_wait_cycles":12416,"thread_start_us":78,"threads_started":1}
I20260811 11:47:55.187599 7721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:55.172859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:41585 (local address 127.20.244.67:35419)
0811 11:47:55.173153 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0811 11:47:55.173174 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 11:47:55.173213 (+ 39us) server_negotiation.cc:407] Connection header received
0811 11:47:55.173895 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:47:55.173901 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:47:55.174315 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:47:55.174632 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:47:55.175941 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:55.176919 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:55.178184 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:47:55.178670 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:47:55.178858 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:55.182143 (+ 3285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:47:55.182148 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:47:55.182160 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:47:55.182190 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:47:55.184466 (+ 2276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:55.185213 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:55.185219 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:55.185225 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:55.185379 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:47:55.186062 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:47:55.186067 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:47:55.186068 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:47:55.186589 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:47:55.186739 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 11:47:55.187126 (+ 387us) server_negotiation.cc:299] Negotiation successful
0811 11:47:55.187419 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":86,"threads_started":1}
I20260811 11:47:55.188292 7717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:55.172497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:35419 (local address 127.20.244.65:41585)
0811 11:47:55.172751 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:55.172768 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:47:55.172907 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:47:55.174679 (+ 1772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:47:55.174686 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:47:55.175313 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:47:55.175751 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:55.175766 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:55.177064 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:55.177072 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:55.178056 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:47:55.178066 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:47:55.178805 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:47:55.178809 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:47:55.179068 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:47:55.179886 (+ 818us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:47:55.179904 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:47:55.181890 (+ 1986us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:47:55.184610 (+ 2720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:55.184616 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:55.184628 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:55.185070 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:55.185495 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:47:55.185499 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:47:55.185501 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:47:55.185694 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:47:55.186703 (+ 1009us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:47:55.186705 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:47:55.186782 (+ 77us) client_negotiation.cc:769] Sending connection context
0811 11:47:55.186971 (+ 189us) client_negotiation.cc:240] Negotiation successful
0811 11:47:55.187481 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":292,"spinlock_wait_cycles":6272,"thread_start_us":68,"threads_started":1}
W20260811 11:47:55.190258 7263 leader_election.cc:341] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2d30217e964f44318106a8946af8790a (127.20.244.67:35419): Not found: Tablet not found: c24c2df4758b43bb96520162865bfd6e
W20260811 11:47:55.190488 7265 leader_election.cc:341] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 187e6eea0db54d77a5b250c10bda2aa3 (127.20.244.66:42363): Not found: Tablet not found: c24c2df4758b43bb96520162865bfd6e
I20260811 11:47:55.190538 7263 leader_election.cc:302] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde1985323994b6d981397f78f0b4ee8; no voters: 187e6eea0db54d77a5b250c10bda2aa3, 2d30217e964f44318106a8946af8790a
I20260811 11:47:55.190852 7716 raft_consensus.cc:2726] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 11:47:55.399660 7717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:55.399343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.65:36961)
0811 11:47:55.399502 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:55.399569 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260811 11:47:55.558195 7724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:55.557779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.66:37715)
0811 11:47:55.558027 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:55.558086 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":77,"threads_started":1}
I20260811 11:47:55.762540 7725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:55.762109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.67:42583)
0811 11:47:55.762359 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:55.762445 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":75,"threads_started":1}
I20260811 11:47:56.401163 7727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:56.400634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.65:36925)
0811 11:47:56.400967 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:56.401055 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":92,"threads_started":1}
I20260811 11:47:56.559662 7728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:56.559148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.66:58457)
0811 11:47:56.559475 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:56.559548 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":90,"threads_started":1}
I20260811 11:47:56.763904 7730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:56.763432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.67:47339)
0811 11:47:56.763712 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:56.763771 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":99,"threads_started":1}
I20260811 11:47:57.073364 7731 raft_consensus.cc:482] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:47:57.073508 7731 raft_consensus.cc:504] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } } peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } }
I20260811 11:47:57.074003 7731 leader_election.cc:288] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d30217e964f44318106a8946af8790a (127.20.244.67:35419), 187e6eea0db54d77a5b250c10bda2aa3 (127.20.244.66:42363)
W20260811 11:47:57.074932 7265 leader_election.cc:341] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 187e6eea0db54d77a5b250c10bda2aa3 (127.20.244.66:42363): Not found: Tablet not found: c24c2df4758b43bb96520162865bfd6e
W20260811 11:47:57.075045 7263 leader_election.cc:341] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2d30217e964f44318106a8946af8790a (127.20.244.67:35419): Not found: Tablet not found: c24c2df4758b43bb96520162865bfd6e
I20260811 11:47:57.075127 7265 leader_election.cc:302] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde1985323994b6d981397f78f0b4ee8; no voters: 187e6eea0db54d77a5b250c10bda2aa3, 2d30217e964f44318106a8946af8790a
I20260811 11:47:57.075296 7731 raft_consensus.cc:2726] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 11:47:57.402631 7732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:57.402135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.65:41013)
0811 11:47:57.402450 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:57.402519 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":102,"threads_started":1}
I20260811 11:47:57.561021 7733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:57.560539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.66:46103)
0811 11:47:57.560819 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:57.560892 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":78,"threads_started":1}
I20260811 11:47:57.765157 7734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:57.764675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.67:52379)
0811 11:47:57.764973 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:57.765053 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":90,"threads_started":1}
I20260811 11:47:58.404429 7735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:58.403834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.65:33531)
0811 11:47:58.404207 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:58.404282 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":108,"threads_started":1}
I20260811 11:47:58.562342 7736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:58.561913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.66:47211)
0811 11:47:58.562179 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:58.562241 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":95,"threads_started":1}
I20260811 11:47:58.766532 7737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:58.766021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.67:37461)
0811 11:47:58.766342 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:58.766414 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":100,"threads_started":1}
I20260811 11:47:58.872488 7738 raft_consensus.cc:482] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:47:58.872632 7738 raft_consensus.cc:504] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } } peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } }
I20260811 11:47:58.873111 7738 leader_election.cc:288] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d30217e964f44318106a8946af8790a (127.20.244.67:35419), 187e6eea0db54d77a5b250c10bda2aa3 (127.20.244.66:42363)
W20260811 11:47:58.873920 7265 leader_election.cc:341] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 187e6eea0db54d77a5b250c10bda2aa3 (127.20.244.66:42363): Not found: Tablet not found: c24c2df4758b43bb96520162865bfd6e
W20260811 11:47:58.874028 7263 leader_election.cc:341] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2d30217e964f44318106a8946af8790a (127.20.244.67:35419): Not found: Tablet not found: c24c2df4758b43bb96520162865bfd6e
I20260811 11:47:58.874140 7263 leader_election.cc:302] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde1985323994b6d981397f78f0b4ee8; no voters: 187e6eea0db54d77a5b250c10bda2aa3, 2d30217e964f44318106a8946af8790a
I20260811 11:47:58.874312 7738 raft_consensus.cc:2726] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 11:47:59.405800 7739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:59.405309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.65:44793)
0811 11:47:59.405632 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:59.405697 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":80,"threads_started":1}
I20260811 11:47:59.563758 7740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:59.563270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.66:47237)
0811 11:47:59.563597 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:59.563659 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":114,"threads_started":1}
I20260811 11:47:59.767793 7741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:47:59.767386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.67:34687)
0811 11:47:59.767633 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 11:47:59.767696 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":74,"threads_started":1}
I20260811 11:48:00.407397 7743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:00.406814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.65:44185)
0811 11:48:00.407180 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:00.407250 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":84,"threads_started":1}
I20260811 11:48:00.565454 7744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:00.564594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.66:42299)
0811 11:48:00.564938 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:00.565006 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":81,"threads_started":1}
I20260811 11:48:00.769016 7745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:00.768540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.67:41749)
0811 11:48:00.768856 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:00.768918 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":74,"threads_started":1}
I20260811 11:48:01.408818 7747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:01.408347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.65:43449)
0811 11:48:01.408642 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:01.408712 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":90,"threads_started":1}
I20260811 11:48:01.566836 7748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:01.566358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.66:59767)
0811 11:48:01.566682 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:01.566738 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":133,"threads_started":1}
I20260811 11:48:01.770381 7749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:01.769814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.67:48083)
0811 11:48:01.770128 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:01.770194 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":104,"threads_started":1}
I20260811 11:48:01.901340 7750 raft_consensus.cc:482] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:48:01.901515 7750 raft_consensus.cc:504] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d30217e964f44318106a8946af8790a" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35419 } } peers { permanent_uuid: "187e6eea0db54d77a5b250c10bda2aa3" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 42363 } } peers { permanent_uuid: "bde1985323994b6d981397f78f0b4ee8" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34181 } }
I20260811 11:48:01.902066 7750 leader_election.cc:288] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d30217e964f44318106a8946af8790a (127.20.244.67:35419), 187e6eea0db54d77a5b250c10bda2aa3 (127.20.244.66:42363)
W20260811 11:48:01.903066 7265 leader_election.cc:341] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 187e6eea0db54d77a5b250c10bda2aa3 (127.20.244.66:42363): Not found: Tablet not found: c24c2df4758b43bb96520162865bfd6e
W20260811 11:48:01.903270 7263 leader_election.cc:341] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2d30217e964f44318106a8946af8790a (127.20.244.67:35419): Not found: Tablet not found: c24c2df4758b43bb96520162865bfd6e
I20260811 11:48:01.903386 7263 leader_election.cc:302] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bde1985323994b6d981397f78f0b4ee8; no voters: 187e6eea0db54d77a5b250c10bda2aa3, 2d30217e964f44318106a8946af8790a
I20260811 11:48:01.903573 7750 raft_consensus.cc:2726] T c24c2df4758b43bb96520162865bfd6e P bde1985323994b6d981397f78f0b4ee8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 11:48:02.410172 7751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:02.409716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.65:43035)
0811 11:48:02.410009 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:02.410073 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":80,"threads_started":1}
I20260811 11:48:02.568120 7752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:02.567656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.66:48047)
0811 11:48:02.567942 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:02.568003 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":93,"threads_started":1}
I20260811 11:48:02.771832 7754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:02.771394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.67:46733)
0811 11:48:02.771667 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:02.771732 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":80,"threads_started":1}
I20260811 11:48:03.411895 7755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:03.411338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.65:50365)
0811 11:48:03.411654 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:03.411773 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":108,"threads_started":1}
I20260811 11:48:03.569411 7757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:03.568967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.66:44199)
0811 11:48:03.569241 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:03.569301 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":92,"threads_started":1}
I20260811 11:48:03.773202 7758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:03.772712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.67:51983)
0811 11:48:03.773011 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:03.773083 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":81,"threads_started":1}
I20260811 11:48:04.413399 7761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:04.412899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.65:58341)
0811 11:48:04.413215 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:04.413286 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":79,"threads_started":1}
I20260811 11:48:04.570768 7762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:04.570271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.66:48253)
0811 11:48:04.570601 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:04.570663 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":122,"threads_started":1}
I20260811 11:48:04.774662 7763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:04.774147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.67:35537)
0811 11:48:04.774476 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:04.774550 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":98,"threads_started":1}
I20260811 11:48:05.414712 7764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:05.414254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.65:54547)
0811 11:48:05.414538 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:05.414600 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":94,"threads_started":1}
I20260811 11:48:05.572109 7767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:05.571645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.66:57651)
0811 11:48:05.571942 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:05.572008 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":96,"threads_started":1}
I20260811 11:48:05.775960 7768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:05.775505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.67:38429)
0811 11:48:05.775793 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:05.775862 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":96,"threads_started":1}
I20260811 11:48:06.416057 7769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:06.415628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.65:56273)
0811 11:48:06.415894 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:06.415957 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":80,"threads_started":1}
I20260811 11:48:06.573396 7771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:06.572950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.66:38243)
0811 11:48:06.573228 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:06.573291 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":88,"threads_started":1}
I20260811 11:48:06.777266 7772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:06.776779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.67:59217)
0811 11:48:06.777095 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:06.777159 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":104,"threads_started":1}
I20260811 11:48:07.417411 7774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:07.416955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.65:50535)
0811 11:48:07.417241 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:07.417300 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":83,"threads_started":1}
I20260811 11:48:07.574664 7775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:07.574186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.66:33863)
0811 11:48:07.574500 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:07.574565 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":75,"threads_started":1}
I20260811 11:48:07.778568 7776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:07.778097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.67:46585)
0811 11:48:07.778410 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:07.778469 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":102,"threads_started":1}
I20260811 11:48:08.418987 7777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:08.418505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.65:38321)
0811 11:48:08.418815 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:08.418888 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":89,"threads_started":1}
I20260811 11:48:08.576125 7778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:08.575667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.66:46493)
0811 11:48:08.575960 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:08.576027 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":76,"threads_started":1}
I20260811 11:48:08.764497 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 7205
I20260811 11:48:08.775542 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 7400
I20260811 11:48:08.780171 7779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:08.779620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40461 (local address 127.20.244.67:41217)
0811 11:48:08.779941 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:08.780023 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:40461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":66,"threads_started":1}
I20260811 11:48:08.785569 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 7558
2026-08-11T11:48:08Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19644 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:48:08 dist-test-slave-vkjp krb5kdc[7783](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:48:08 dist-test-slave-vkjp krb5kdc[7783](info): set up 2 sockets
Aug 11 11:48:08 dist-test-slave-vkjp krb5kdc[7783](info): commencing operation
krb5kdc: starting...
W20260811 11:48:10.004422 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.192s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:48:10 dist-test-slave-vkjp krb5kdc[7783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448890, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:48:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:48:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:48:10.138680 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:39665
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:43143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:39665
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:48:10.256294 7798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:48:10.256596 7798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:48:10.256680 7798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:48:10.260763 7798 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 11:48:10.260843 7798 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 11:48:10.260878 7798 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 11:48:10.260913 7798 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:48:10.260973 7798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:48:10.261051 7798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:48:10.261092 7798 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:48:10.261129 7798 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:48:10.266425 7798 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:43143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:39665
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:39665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:48:10.267602 7798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:48:10.268643 7798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:48:10.277586 7807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:48:10.277599 7804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:48:10.277609 7805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:48:10.277952 7798 server_base.cc:1034] running on GCE node
I20260811 11:48:10.278496 7798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:48:10.279697 7798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:48:10.280896 7798 hybrid_clock.cc:648] HybridClock initialized: now 1786448890280878 us; error 30 us; skew 500 ppm
Aug 11 11:48:10 dist-test-slave-vkjp krb5kdc[7783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448890, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:48:10.283735 7798 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:48:10.284655 7798 webserver.cc:460] Webserver started at http://127.20.244.126:45067/ using document root <none> and password file <none>
I20260811 11:48:10.285220 7798 fs_manager.cc:359] Metadata directory not provided
I20260811 11:48:10.285358 7798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:48:10.285591 7798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:48:10.287730 7798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "8852f95e54dc44bbb5e598a2be64eb3e"
format_stamp: "Formatted at 2026-08-11 11:48:10 on dist-test-slave-vkjp"
server_key: "d7fc853a139f8932cde469dd3413f0d0"
server_key_iv: "ab8bc27bcf28d88ffff470f93f877892"
server_key_version: "encryptionkey@0"
I20260811 11:48:10.288304 7798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "8852f95e54dc44bbb5e598a2be64eb3e"
format_stamp: "Formatted at 2026-08-11 11:48:10 on dist-test-slave-vkjp"
server_key: "d7fc853a139f8932cde469dd3413f0d0"
server_key_iv: "ab8bc27bcf28d88ffff470f93f877892"
server_key_version: "encryptionkey@0"
I20260811 11:48:10.292140 7798 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 11:48:10.294607 7816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:10.295997 7798 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:48:10.296157 7798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "8852f95e54dc44bbb5e598a2be64eb3e"
format_stamp: "Formatted at 2026-08-11 11:48:10 on dist-test-slave-vkjp"
server_key: "d7fc853a139f8932cde469dd3413f0d0"
server_key_iv: "ab8bc27bcf28d88ffff470f93f877892"
server_key_version: "encryptionkey@0"
I20260811 11:48:10.296288 7798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:48:10.331665 7798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:48:10.334988 7798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:48:10.335235 7798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:48:10.342808 7798 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:39665
I20260811 11:48:10.343142 7884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:39665 every 8 connection(s)
I20260811 11:48:10.343880 7798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:48:10.346681 7885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:48:10.346887 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 7798
I20260811 11:48:10.347014 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:48:10.347383 21457 external_mini_cluster.cc:1428] Setting key fdd6af1039b5a318e7ce43f71e39dafa
I20260811 11:48:10.354257 7885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e: Bootstrap starting.
I20260811 11:48:10.357398 7885 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e: Neither blocks nor log segments found. Creating new log.
Aug 11 11:48:10 dist-test-slave-vkjp krb5kdc[7783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448890, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:48:10.358412 7885 log.cc:824] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e: Log is configured to *not* fsync() on all Append() calls
I20260811 11:48:10.360553 7885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e: No bootstrap required, opened a new log
I20260811 11:48:10.363495 7888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:10.348797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48416 (local address 127.20.244.126:39665)
0811 11:48:10.349226 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:10.349245 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:10.349287 (+ 42us) server_negotiation.cc:407] Connection header received
0811 11:48:10.350093 (+ 806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:10.350117 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:10.350553 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:10.350933 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:48:10.351653 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:10.353384 (+ 1731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:10.354246 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:10.355016 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:10.355226 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:10.358141 (+ 2915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:48:10.358151 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:48:10.358173 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:48:10.358215 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:48:10.360382 (+ 2167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:10.360903 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:10.360909 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:10.360914 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:10.361060 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:10.361368 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:10.361371 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:10.361372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:10.361840 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:48:10.362014 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:10.362284 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 11:48:10.362617 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":111,"threads_started":1}
I20260811 11:48:10.364712 7885 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39665 } }
I20260811 11:48:10.365020 7885 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:48:10.365072 7885 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8852f95e54dc44bbb5e598a2be64eb3e, State: Initialized, Role: FOLLOWER
I20260811 11:48:10.365515 7885 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39665 } }
I20260811 11:48:10.365711 7885 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:48:10.365797 7885 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:48:10.365927 7885 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:48:10.366849 7885 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39665 } }
I20260811 11:48:10.367255 7885 leader_election.cc:302] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8852f95e54dc44bbb5e598a2be64eb3e; no voters:
I20260811 11:48:10.367592 7885 leader_election.cc:288] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:48:10.367723 7890 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:48:10.367986 7890 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 1 LEADER]: Becoming Leader. State: Replica: 8852f95e54dc44bbb5e598a2be64eb3e, State: Running, Role: LEADER
I20260811 11:48:10.368379 7890 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39665 } }
I20260811 11:48:10.368808 7885 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:48:10.370067 7892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8852f95e54dc44bbb5e598a2be64eb3e. Latest consensus state: current_term: 1 leader_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39665 } } }
I20260811 11:48:10.370201 7892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [sys.catalog]: This master's current role is: LEADER
I20260811 11:48:10.370604 7901 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:48:10.370587 7891 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39665 } } }
I20260811 11:48:10.371479 7891 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [sys.catalog]: This master's current role is: LEADER
I20260811 11:48:10.373813 7901 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:48:10.379026 7901 catalog_manager.cc:1347] Generated new cluster ID: ca16085ff7cf4d9a91a1d53d18c57aee
I20260811 11:48:10.379120 7901 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:48:10.410796 7901 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:48:10.412192 7901 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:48:10.419587 7901 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e: Generated new TSK 0
I20260811 11:48:10.420433 7901 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.244.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
I20260811 11:48:10.458703 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:39665
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:43143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:48:10.576984 7915 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:48:10.577324 7915 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:48:10.577467 7915 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:48:10.581569 7915 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:48:10.581627 7915 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:48:10.581720 7915 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:48:10.587363 7915 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:43143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:39665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7915
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:48:10.588649 7915 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:48:10.589632 7915 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:48:10.599599 7926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:48:10.599622 7928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:48:10.599682 7922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:48:10.599979 7915 server_base.cc:1034] running on GCE node
I20260811 11:48:10.600553 7915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:48:10.601334 7915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:48:10.602505 7915 hybrid_clock.cc:648] HybridClock initialized: now 1786448890602469 us; error 46 us; skew 500 ppm
Aug 11 11:48:10 dist-test-slave-vkjp krb5kdc[7783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448890, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:48:10.605509 7915 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:48:10.606412 7915 webserver.cc:460] Webserver started at http://127.20.244.65:36391/ using document root <none> and password file <none>
I20260811 11:48:10.606987 7915 fs_manager.cc:359] Metadata directory not provided
I20260811 11:48:10.607079 7915 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:48:10.607352 7915 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:48:10.609433 7915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "546aa53b59de4776a6c70558f49b4d2e"
format_stamp: "Formatted at 2026-08-11 11:48:10 on dist-test-slave-vkjp"
server_key: "c8616358b54fc32463f5a2c6346ffe73"
server_key_iv: "de8563c4d20837e7651e1a3d22e100c4"
server_key_version: "encryptionkey@0"
I20260811 11:48:10.610056 7915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "546aa53b59de4776a6c70558f49b4d2e"
format_stamp: "Formatted at 2026-08-11 11:48:10 on dist-test-slave-vkjp"
server_key: "c8616358b54fc32463f5a2c6346ffe73"
server_key_iv: "de8563c4d20837e7651e1a3d22e100c4"
server_key_version: "encryptionkey@0"
I20260811 11:48:10.614392 7915 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 11:48:10.617189 7939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:10.618716 7915 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 11:48:10.618825 7915 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "546aa53b59de4776a6c70558f49b4d2e"
format_stamp: "Formatted at 2026-08-11 11:48:10 on dist-test-slave-vkjp"
server_key: "c8616358b54fc32463f5a2c6346ffe73"
server_key_iv: "de8563c4d20837e7651e1a3d22e100c4"
server_key_version: "encryptionkey@0"
I20260811 11:48:10.618929 7915 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:48:10.627928 7915 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:48:10.631204 7915 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:48:10.631371 7915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:48:10.631919 7915 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:48:10.632710 7915 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:48:10.632756 7915 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:10.632795 7915 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:48:10.632812 7915 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:10.641737 7915 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:46533
I20260811 11:48:10.641765 8075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:46533 every 8 connection(s)
I20260811 11:48:10.642656 7915 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:48:10.646545 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 7915
I20260811 11:48:10.646651 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:48:10.646946 21457 external_mini_cluster.cc:1428] Setting key e24b49729f65e90e49df88ec1e45d459
Aug 11 11:48:10 dist-test-slave-vkjp krb5kdc[7783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448890, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.244.66@KRBTEST.COM; defaulting to no policy
I20260811 11:48:10.658092 7888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:10.644654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:40443 (local address 127.20.244.126:39665)
0811 11:48:10.644799 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:10.644802 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:10.645628 (+ 826us) server_negotiation.cc:407] Connection header received
0811 11:48:10.647136 (+ 1508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:10.647140 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:10.647226 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:10.647328 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:48:10.648780 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:10.649587 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:10.650946 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:10.651248 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:10.651344 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:10.654370 (+ 3026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:48:10.654374 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:48:10.654376 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:48:10.654401 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:48:10.655919 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:10.656462 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:10.656466 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:10.656468 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:10.656553 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:10.656920 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:10.656923 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:10.656925 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:10.657113 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:48:10.657213 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:10.657793 (+ 580us) server_negotiation.cc:299] Negotiation successful
0811 11:48:10.657924 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 11:48:10.658996 8078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:10.644955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.65:40443)
0811 11:48:10.645448 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:10.645493 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 11:48:10.646867 (+ 1374us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:48:10.647551 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:48:10.647561 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:48:10.647997 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:48:10.648584 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:10.648598 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:10.649719 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:10.649722 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:10.650809 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:10.650824 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:10.651421 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:10.651428 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:10.651651 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:10.652376 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:48:10.652402 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:48:10.654183 (+ 1781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:48:10.656045 (+ 1862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:48:10.656052 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:48:10.656068 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:48:10.656339 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:48:10.656657 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:48:10.656661 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:48:10.656663 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:48:10.656809 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:48:10.657229 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:48:10.657237 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:48:10.657492 (+ 255us) client_negotiation.cc:769] Sending connection context
0811 11:48:10.657750 (+ 258us) client_negotiation.cc:240] Negotiation successful
0811 11:48:10.658101 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":130,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.66@KRBTEST.COM" created.
I20260811 11:48:10.660553 8076 heartbeater.cc:347] Connected to a master server at 127.20.244.126:39665
I20260811 11:48:10.660851 8076 heartbeater.cc:464] Registering TS with master...
I20260811 11:48:10.661391 8076 heartbeater.cc:511] Master 127.20.244.126:39665 requested a full tablet report, sending...
I20260811 11:48:10.663038 7840 ts_manager.cc:194] Registered new tserver with Master: 546aa53b59de4776a6c70558f49b4d2e (127.20.244.65:46533)
I20260811 11:48:10.664239 7840 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:40443
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
I20260811 11:48:10.678644 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:39665
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:43143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:48:10.799822 8082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:48:10.800102 8082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:48:10.800195 8082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:48:10.804350 8082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:48:10.804418 8082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:48:10.804476 8082 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:48:10.809859 8082 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:43143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:39665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:48:10.810948 8082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:48:10.812021 8082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:48:10.822111 8082 server_base.cc:1034] running on GCE node
W20260811 11:48:10.822182 8092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:48:10.822329 8089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:48:10.822154 8090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:48:10.822822 8082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:48:10.823629 8082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:48:10.824833 8082 hybrid_clock.cc:648] HybridClock initialized: now 1786448890824803 us; error 34 us; skew 500 ppm
Aug 11 11:48:10 dist-test-slave-vkjp krb5kdc[7783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448890, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:48:10.827809 8082 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:48:10.828673 8082 webserver.cc:460] Webserver started at http://127.20.244.66:42035/ using document root <none> and password file <none>
I20260811 11:48:10.829239 8082 fs_manager.cc:359] Metadata directory not provided
I20260811 11:48:10.829335 8082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:48:10.829569 8082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:48:10.831631 8082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "72737f54fafa4addac27a299bc526914"
format_stamp: "Formatted at 2026-08-11 11:48:10 on dist-test-slave-vkjp"
server_key: "09bde2628fc600fe0277899e8b06f265"
server_key_iv: "e55439db85f1520e93fe0de24557dfc9"
server_key_version: "encryptionkey@0"
I20260811 11:48:10.832206 8082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "72737f54fafa4addac27a299bc526914"
format_stamp: "Formatted at 2026-08-11 11:48:10 on dist-test-slave-vkjp"
server_key: "09bde2628fc600fe0277899e8b06f265"
server_key_iv: "e55439db85f1520e93fe0de24557dfc9"
server_key_version: "encryptionkey@0"
I20260811 11:48:10.836062 8082 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 11:48:10.838506 8104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:10.839825 8082 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:48:10.839955 8082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "72737f54fafa4addac27a299bc526914"
format_stamp: "Formatted at 2026-08-11 11:48:10 on dist-test-slave-vkjp"
server_key: "09bde2628fc600fe0277899e8b06f265"
server_key_iv: "e55439db85f1520e93fe0de24557dfc9"
server_key_version: "encryptionkey@0"
I20260811 11:48:10.840067 8082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:48:10.850272 8082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:48:10.853503 8082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:48:10.853709 8082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:48:10.854297 8082 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:48:10.855180 8082 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:48:10.855247 8082 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:10.855312 8082 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:48:10.855365 8082 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:10.864459 8082 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:40787
I20260811 11:48:10.864533 8245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:40787 every 8 connection(s)
I20260811 11:48:10.865379 8082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:48:10.866779 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 8082
I20260811 11:48:10.866911 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:48:10.867338 21457 external_mini_cluster.cc:1428] Setting key 2397c848a5ec2ad4285da3b4a12cd84f
Aug 11 11:48:10 dist-test-slave-vkjp krb5kdc[7783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448890, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.244.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.67@KRBTEST.COM" created.
I20260811 11:48:10.881969 7888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:10.867504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:56907 (local address 127.20.244.126:39665)
0811 11:48:10.867689 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:10.867695 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:10.868630 (+ 935us) server_negotiation.cc:407] Connection header received
0811 11:48:10.870676 (+ 2046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:10.870679 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:10.870722 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:10.870796 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:48:10.872281 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:10.873165 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:10.874503 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:10.874744 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:10.874863 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:10.877876 (+ 3013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:48:10.877887 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:48:10.877890 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:48:10.877914 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:48:10.879546 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:10.880174 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:10.880178 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:10.880179 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:10.880259 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:10.880656 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:10.880660 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:10.880661 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:10.880862 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:48:10.880971 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:10.881627 (+ 656us) server_negotiation.cc:299] Negotiation successful
0811 11:48:10.881789 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 11:48:10.883054 8249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:10.867953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.66:56907)
0811 11:48:10.868475 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:10.868520 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 11:48:10.870435 (+ 1915us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:48:10.870991 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:48:10.871003 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:48:10.871589 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:48:10.872115 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:10.872130 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:10.873338 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:10.873341 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:10.874372 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:10.874388 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:10.874909 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:10.874913 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:10.875145 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:10.875788 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:48:10.875816 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:48:10.877677 (+ 1861us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:48:10.879679 (+ 2002us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:48:10.879686 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:48:10.879704 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:48:10.880046 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:48:10.880380 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:48:10.880383 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:48:10.880386 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:48:10.880545 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:48:10.880971 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:48:10.880979 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:48:10.881359 (+ 380us) client_negotiation.cc:769] Sending connection context
0811 11:48:10.881580 (+ 221us) client_negotiation.cc:240] Negotiation successful
0811 11:48:10.881941 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":162,"threads_started":1}
I20260811 11:48:10.884358 8246 heartbeater.cc:347] Connected to a master server at 127.20.244.126:39665
I20260811 11:48:10.884652 8246 heartbeater.cc:464] Registering TS with master...
I20260811 11:48:10.885311 8246 heartbeater.cc:511] Master 127.20.244.126:39665 requested a full tablet report, sending...
I20260811 11:48:10.886585 7840 ts_manager.cc:194] Registered new tserver with Master: 72737f54fafa4addac27a299bc526914 (127.20.244.66:40787)
I20260811 11:48:10.887395 7840 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:56907
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
I20260811 11:48:10.902549 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:39665
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:43143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:48:11.021867 8253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:48:11.022186 8253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:48:11.022264 8253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:48:11.026556 8253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:48:11.026654 8253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:48:11.026749 8253 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:48:11.032169 8253 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:43143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:39665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:48:11.033286 8253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:48:11.034319 8253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:48:11.044127 8262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:48:11.044116 8259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:48:11.044116 8260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:48:11.044495 8253 server_base.cc:1034] running on GCE node
I20260811 11:48:11.044912 8253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:48:11.045595 8253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:48:11.046801 8253 hybrid_clock.cc:648] HybridClock initialized: now 1786448891046764 us; error 47 us; skew 500 ppm
Aug 11 11:48:11 dist-test-slave-vkjp krb5kdc[7783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448891, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:48:11.049902 8253 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:48:11.050901 8253 webserver.cc:460] Webserver started at http://127.20.244.67:42905/ using document root <none> and password file <none>
I20260811 11:48:11.051568 8253 fs_manager.cc:359] Metadata directory not provided
I20260811 11:48:11.051672 8253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:48:11.051944 8253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:48:11.054152 8253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "c6158cdf54e44739a475735c0e2a1fa0"
format_stamp: "Formatted at 2026-08-11 11:48:11 on dist-test-slave-vkjp"
server_key: "e38db30d1b2c0a32e6bb46e29ecd12cd"
server_key_iv: "c0a3a194b8fc6ddb7f33977f7ea1cdaa"
server_key_version: "encryptionkey@0"
I20260811 11:48:11.054813 8253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "c6158cdf54e44739a475735c0e2a1fa0"
format_stamp: "Formatted at 2026-08-11 11:48:11 on dist-test-slave-vkjp"
server_key: "e38db30d1b2c0a32e6bb46e29ecd12cd"
server_key_iv: "c0a3a194b8fc6ddb7f33977f7ea1cdaa"
server_key_version: "encryptionkey@0"
I20260811 11:48:11.059016 8253 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 11:48:11.061714 8270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:11.063043 8253 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 11:48:11.063262 8253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "c6158cdf54e44739a475735c0e2a1fa0"
format_stamp: "Formatted at 2026-08-11 11:48:11 on dist-test-slave-vkjp"
server_key: "e38db30d1b2c0a32e6bb46e29ecd12cd"
server_key_iv: "c0a3a194b8fc6ddb7f33977f7ea1cdaa"
server_key_version: "encryptionkey@0"
I20260811 11:48:11.063390 8253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:48:11.078878 8253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:48:11.082289 8253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:48:11.082525 8253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:48:11.083199 8253 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:48:11.084067 8253 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:48:11.084139 8253 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:11.084210 8253 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:48:11.084259 8253 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:11.093760 8253 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:33909
I20260811 11:48:11.093784 8415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:33909 every 8 connection(s)
I20260811 11:48:11.094707 8253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:48:11.100709 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 8253
I20260811 11:48:11.100840 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:48:11.101166 21457 external_mini_cluster.cc:1428] Setting key c9a7992731062018cc916cc8b4e738e7
Aug 11 11:48:11 dist-test-slave-vkjp krb5kdc[7783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448891, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:48:11.109634 7888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:11.096541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:56483 (local address 127.20.244.126:39665)
0811 11:48:11.096721 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:11.096726 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:11.097613 (+ 887us) server_negotiation.cc:407] Connection header received
0811 11:48:11.098985 (+ 1372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:11.098991 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:11.099055 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:11.099175 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:48:11.100473 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.101342 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.102805 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.103179 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.103272 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:11.105735 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:48:11.105738 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:48:11.105740 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:48:11.105765 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:48:11.107383 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:11.107989 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:11.107992 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:11.107993 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:11.108078 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:11.108497 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:11.108499 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:11.108500 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:11.108687 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:48:11.108757 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:11.109358 (+ 601us) server_negotiation.cc:299] Negotiation successful
0811 11:48:11.109504 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 11:48:11.110574 8418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:11.096979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.67:56483)
0811 11:48:11.097441 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:11.097487 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 11:48:11.098755 (+ 1268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:48:11.099358 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:48:11.099365 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:48:11.099816 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:48:11.100294 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:11.100310 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.101467 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.101470 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:11.102687 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:11.102697 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.103342 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.103348 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:11.103594 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:11.104133 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:48:11.104150 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:48:11.105581 (+ 1431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:48:11.107501 (+ 1920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:48:11.107507 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:48:11.107521 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:48:11.107884 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:48:11.108224 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:48:11.108227 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:48:11.108228 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:48:11.108405 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:48:11.108796 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:48:11.108801 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:48:11.109085 (+ 284us) client_negotiation.cc:769] Sending connection context
0811 11:48:11.109259 (+ 174us) client_negotiation.cc:240] Negotiation successful
0811 11:48:11.109582 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":119,"threads_started":1}
I20260811 11:48:11.111883 8416 heartbeater.cc:347] Connected to a master server at 127.20.244.126:39665
I20260811 11:48:11.112119 8416 heartbeater.cc:464] Registering TS with master...
I20260811 11:48:11.112614 8416 heartbeater.cc:511] Master 127.20.244.126:39665 requested a full tablet report, sending...
I20260811 11:48:11.113643 7840 ts_manager.cc:194] Registered new tserver with Master: c6158cdf54e44739a475735c0e2a1fa0 (127.20.244.67:33909)
I20260811 11:48:11.114441 7840 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:56483
I20260811 11:48:11.115476 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:48:11.125629 7888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:11.117876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49396 (local address 127.20.244.126:39665)
0811 11:48:11.117998 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:11.118002 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:11.118211 (+ 209us) server_negotiation.cc:407] Connection header received
0811 11:48:11.118333 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:11.118335 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:11.118373 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:11.118447 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:48:11.119281 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.119788 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.120620 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.120824 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.120903 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:11.122702 (+ 1799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:48:11.122709 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:48:11.122714 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:48:11.122739 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:48:11.124148 (+ 1409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:11.124556 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:11.124559 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:11.124560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:11.124633 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:11.124916 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:11.124918 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:11.124919 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:11.125121 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:48:11.125223 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:11.125419 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 11:48:11.125512 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 11:48:11.128470 7840 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49396:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:48:11.131618 7840 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:48:11.147006 8431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:11.141234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52374 (local address 127.20.244.66:40787)
0811 11:48:11.142765 (+ 1531us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:11.142782 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:11.142800 (+ 18us) server_negotiation.cc:407] Connection header received
0811 11:48:11.142865 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:11.142886 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:11.143066 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:11.143259 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:48:11.143435 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.144480 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.145687 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.146287 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.146402 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:11.146551 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:11.146732 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 11:48:11.146837 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1397,"thread_start_us":118,"threads_started":1}
I20260811 11:48:11.147006 8429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:11.140633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:40787 (local address 127.0.0.1:52374)
0811 11:48:11.141655 (+ 1022us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:11.141710 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 11:48:11.141852 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:48:11.143226 (+ 1374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:48:11.143229 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:48:11.143246 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:48:11.143342 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:11.143348 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.144606 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.144610 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:11.145565 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:11.145574 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.146415 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.146419 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:11.146530 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:11.146573 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 11:48:11.146692 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 11:48:11.146823 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":912,"mutex_wait_us":629,"thread_start_us":125,"threads_started":1}
I20260811 11:48:11.147491 8432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:11.140595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:33909 (local address 127.0.0.1:50206)
0811 11:48:11.141655 (+ 1060us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:11.141708 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 11:48:11.141867 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:48:11.142645 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:48:11.142651 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:48:11.142674 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:48:11.142803 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:11.142810 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.144359 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.144364 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:11.145772 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:11.145783 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.147041 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.147044 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:11.147178 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:11.147212 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 11:48:11.147287 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 11:48:11.147359 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":881,"thread_start_us":112,"threads_started":1}
I20260811 11:48:11.147944 8430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:11.140927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50206 (local address 127.20.244.67:33909)
0811 11:48:11.141377 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:11.141389 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:11.141793 (+ 404us) server_negotiation.cc:407] Connection header received
0811 11:48:11.142040 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:11.142048 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:11.142240 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:11.142414 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:48:11.142942 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.144181 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.145912 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.146740 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.146814 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:11.146940 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:11.147325 (+ 385us) server_negotiation.cc:299] Negotiation successful
0811 11:48:11.147430 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":173,"threads_started":1}
I20260811 11:48:11.149289 8433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:11.141643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:46533 (local address 127.0.0.1:48532)
0811 11:48:11.142429 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:11.142440 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:48:11.142500 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:48:11.142927 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:48:11.142930 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:48:11.142959 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:48:11.143065 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:11.143072 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.145033 (+ 1961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.145036 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:11.146152 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:11.146162 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.147447 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.147451 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:11.148994 (+ 1543us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:11.149020 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 11:48:11.149098 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 11:48:11.149167 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":736,"thread_start_us":96,"threads_started":1}
I20260811 11:48:11.149789 8435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:11.142106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48532 (local address 127.20.244.65:46533)
0811 11:48:11.142445 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:11.142462 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:11.142499 (+ 37us) server_negotiation.cc:407] Connection header received
0811 11:48:11.142601 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:11.142609 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:11.142781 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:11.143006 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:48:11.143190 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.144475 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.146279 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.147121 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.147230 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:11.147384 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:11.149533 (+ 2149us) server_negotiation.cc:299] Negotiation successful
0811 11:48:11.149636 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":120,"threads_started":1}
I20260811 11:48:11.150501 8167 tablet_service.cc:1467] Processing CreateTablet for tablet b5a5f8b835b44e51ac5fed2027bf7944 (DEFAULT_TABLE table=test-table [id=0e3c3c26e0f549699650a0cc258d507f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:48:11.150847 8333 tablet_service.cc:1467] Processing CreateTablet for tablet b5a5f8b835b44e51ac5fed2027bf7944 (DEFAULT_TABLE table=test-table [id=0e3c3c26e0f549699650a0cc258d507f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:48:11.151741 8167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5a5f8b835b44e51ac5fed2027bf7944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:48:11.151806 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5a5f8b835b44e51ac5fed2027bf7944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:48:11.152374 7996 tablet_service.cc:1467] Processing CreateTablet for tablet b5a5f8b835b44e51ac5fed2027bf7944 (DEFAULT_TABLE table=test-table [id=0e3c3c26e0f549699650a0cc258d507f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:48:11.153373 7996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5a5f8b835b44e51ac5fed2027bf7944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:48:11.158027 8436 tablet_bootstrap.cc:492] T b5a5f8b835b44e51ac5fed2027bf7944 P c6158cdf54e44739a475735c0e2a1fa0: Bootstrap starting.
I20260811 11:48:11.159410 8437 tablet_bootstrap.cc:492] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914: Bootstrap starting.
I20260811 11:48:11.160241 8438 tablet_bootstrap.cc:492] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e: Bootstrap starting.
I20260811 11:48:11.161737 8436 tablet_bootstrap.cc:654] T b5a5f8b835b44e51ac5fed2027bf7944 P c6158cdf54e44739a475735c0e2a1fa0: Neither blocks nor log segments found. Creating new log.
I20260811 11:48:11.161897 8437 tablet_bootstrap.cc:654] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914: Neither blocks nor log segments found. Creating new log.
I20260811 11:48:11.162290 8438 tablet_bootstrap.cc:654] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e: Neither blocks nor log segments found. Creating new log.
I20260811 11:48:11.162695 8437 log.cc:824] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914: Log is configured to *not* fsync() on all Append() calls
I20260811 11:48:11.163035 8438 log.cc:824] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e: Log is configured to *not* fsync() on all Append() calls
I20260811 11:48:11.163035 8436 log.cc:824] T b5a5f8b835b44e51ac5fed2027bf7944 P c6158cdf54e44739a475735c0e2a1fa0: Log is configured to *not* fsync() on all Append() calls
I20260811 11:48:11.164628 8437 tablet_bootstrap.cc:492] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914: No bootstrap required, opened a new log
I20260811 11:48:11.164836 8437 ts_tablet_manager.cc:1397] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 11:48:11.164969 8436 tablet_bootstrap.cc:492] T b5a5f8b835b44e51ac5fed2027bf7944 P c6158cdf54e44739a475735c0e2a1fa0: No bootstrap required, opened a new log
I20260811 11:48:11.164960 8438 tablet_bootstrap.cc:492] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e: No bootstrap required, opened a new log
I20260811 11:48:11.165145 8436 ts_tablet_manager.cc:1397] T b5a5f8b835b44e51ac5fed2027bf7944 P c6158cdf54e44739a475735c0e2a1fa0: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.002s
I20260811 11:48:11.165145 8438 ts_tablet_manager.cc:1397] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 11:48:11.168267 8437 raft_consensus.cc:348] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:11.168557 8437 raft_consensus.cc:374] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:48:11.168715 8437 raft_consensus.cc:729] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72737f54fafa4addac27a299bc526914, State: Initialized, Role: FOLLOWER
I20260811 11:48:11.169203 8437 consensus_queue.cc:260] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:11.169145 8436 raft_consensus.cc:348] T b5a5f8b835b44e51ac5fed2027bf7944 P c6158cdf54e44739a475735c0e2a1fa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:11.169431 8436 raft_consensus.cc:374] T b5a5f8b835b44e51ac5fed2027bf7944 P c6158cdf54e44739a475735c0e2a1fa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:48:11.169498 8436 raft_consensus.cc:729] T b5a5f8b835b44e51ac5fed2027bf7944 P c6158cdf54e44739a475735c0e2a1fa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6158cdf54e44739a475735c0e2a1fa0, State: Initialized, Role: FOLLOWER
I20260811 11:48:11.169353 8438 raft_consensus.cc:348] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:11.169582 8438 raft_consensus.cc:374] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:48:11.169643 8438 raft_consensus.cc:729] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aa53b59de4776a6c70558f49b4d2e, State: Initialized, Role: FOLLOWER
I20260811 11:48:11.170027 8436 consensus_queue.cc:260] T b5a5f8b835b44e51ac5fed2027bf7944 P c6158cdf54e44739a475735c0e2a1fa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:11.170027 8438 consensus_queue.cc:260] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:11.170140 8246 heartbeater.cc:503] Master 127.20.244.126:39665 was elected leader, sending a full tablet report...
I20260811 11:48:11.170302 8437 ts_tablet_manager.cc:1428] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 11:48:11.170969 8436 ts_tablet_manager.cc:1428] T b5a5f8b835b44e51ac5fed2027bf7944 P c6158cdf54e44739a475735c0e2a1fa0: Time spent starting tablet: real 0.006s user 0.005s sys 0.002s
I20260811 11:48:11.170969 8438 ts_tablet_manager.cc:1428] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 11:48:11.171303 8076 heartbeater.cc:503] Master 127.20.244.126:39665 was elected leader, sending a full tablet report...
I20260811 11:48:11.171303 8416 heartbeater.cc:503] Master 127.20.244.126:39665 was elected leader, sending a full tablet report...
I20260811 11:48:11.235646 8442 raft_consensus.cc:482] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:48:11.235867 8442 raft_consensus.cc:504] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:11.237020 8442 leader_election.cc:288] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6158cdf54e44739a475735c0e2a1fa0 (127.20.244.67:33909), 546aa53b59de4776a6c70558f49b4d2e (127.20.244.65:46533)
I20260811 11:48:11.240918 8249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:11.237322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:46533 (local address 127.20.244.66:34535)
0811 11:48:11.237493 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:11.237512 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 11:48:11.237622 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:48:11.237928 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:48:11.237931 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:48:11.237949 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:48:11.238067 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:11.238073 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.238827 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.238830 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:11.239674 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:11.239684 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.240477 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.240481 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:11.240587 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:11.240612 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 11:48:11.240687 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 11:48:11.240750 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 11:48:11.240936 8435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:11.237474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:34535 (local address 127.20.244.65:46533)
0811 11:48:11.237601 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:11.237606 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:11.237623 (+ 17us) server_negotiation.cc:407] Connection header received
0811 11:48:11.237757 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:11.237761 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:11.237812 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:11.237912 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:48:11.238174 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.238699 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.239807 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.240344 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.240463 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:11.240514 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:11.240725 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 11:48:11.240800 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 11:48:11.241696 8021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5a5f8b835b44e51ac5fed2027bf7944" candidate_uuid: "72737f54fafa4addac27a299bc526914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aa53b59de4776a6c70558f49b4d2e" is_pre_election: true
I20260811 11:48:11.242055 8021 raft_consensus.cc:2454] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72737f54fafa4addac27a299bc526914 in term 0.
I20260811 11:48:11.242108 8446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:11.237328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:33909 (local address 127.20.244.66:58977)
0811 11:48:11.237895 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:11.237906 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:48:11.238033 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:48:11.238288 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:48:11.238290 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:48:11.238306 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:48:11.238423 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:11.238429 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.239156 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.239162 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:11.240725 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:11.240733 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.241720 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.241723 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:11.241795 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:11.241815 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 11:48:11.241936 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 11:48:11.242001 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"mutex_wait_us":204,"thread_start_us":152,"threads_started":1}
I20260811 11:48:11.242218 8430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:11.237455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:58977 (local address 127.20.244.67:33909)
0811 11:48:11.237610 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:11.237617 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:11.237999 (+ 382us) server_negotiation.cc:407] Connection header received
0811 11:48:11.238148 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:11.238151 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:11.238199 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:11.238277 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:48:11.238541 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.239023 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.240879 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.241545 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.241668 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:11.241729 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:11.242019 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 11:48:11.242106 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 11:48:11.242617 8107 leader_election.cc:302] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aa53b59de4776a6c70558f49b4d2e, 72737f54fafa4addac27a299bc526914; no voters:
I20260811 11:48:11.242801 8360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5a5f8b835b44e51ac5fed2027bf7944" candidate_uuid: "72737f54fafa4addac27a299bc526914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6158cdf54e44739a475735c0e2a1fa0" is_pre_election: true
I20260811 11:48:11.242899 8442 raft_consensus.cc:2781] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:48:11.242988 8442 raft_consensus.cc:482] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:48:11.243043 8442 raft_consensus.cc:3037] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:48:11.243177 8360 raft_consensus.cc:2454] T b5a5f8b835b44e51ac5fed2027bf7944 P c6158cdf54e44739a475735c0e2a1fa0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72737f54fafa4addac27a299bc526914 in term 0.
I20260811 11:48:11.244294 8442 raft_consensus.cc:504] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:11.244673 8442 leader_election.cc:288] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914 [CANDIDATE]: Term 1 election: Requested vote from peers c6158cdf54e44739a475735c0e2a1fa0 (127.20.244.67:33909), 546aa53b59de4776a6c70558f49b4d2e (127.20.244.65:46533)
I20260811 11:48:11.244988 8360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5a5f8b835b44e51ac5fed2027bf7944" candidate_uuid: "72737f54fafa4addac27a299bc526914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6158cdf54e44739a475735c0e2a1fa0"
I20260811 11:48:11.245029 8021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5a5f8b835b44e51ac5fed2027bf7944" candidate_uuid: "72737f54fafa4addac27a299bc526914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aa53b59de4776a6c70558f49b4d2e"
I20260811 11:48:11.245123 8360 raft_consensus.cc:3037] T b5a5f8b835b44e51ac5fed2027bf7944 P c6158cdf54e44739a475735c0e2a1fa0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:48:11.245153 8021 raft_consensus.cc:3037] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:48:11.246199 8360 raft_consensus.cc:2454] T b5a5f8b835b44e51ac5fed2027bf7944 P c6158cdf54e44739a475735c0e2a1fa0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72737f54fafa4addac27a299bc526914 in term 1.
I20260811 11:48:11.246201 8021 raft_consensus.cc:2454] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72737f54fafa4addac27a299bc526914 in term 1.
I20260811 11:48:11.246532 8105 leader_election.cc:302] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 546aa53b59de4776a6c70558f49b4d2e, 72737f54fafa4addac27a299bc526914, c6158cdf54e44739a475735c0e2a1fa0; no voters:
I20260811 11:48:11.246724 8442 raft_consensus.cc:2781] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:48:11.246978 8442 raft_consensus.cc:686] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914 [term 1 LEADER]: Becoming Leader. State: Replica: 72737f54fafa4addac27a299bc526914, State: Running, Role: LEADER
I20260811 11:48:11.247332 8442 consensus_queue.cc:237] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:11.250694 7838 catalog_manager.cc:5495] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72737f54fafa4addac27a299bc526914 (127.20.244.66). New cstate: current_term: 1 leader_uuid: "72737f54fafa4addac27a299bc526914" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } health_report { overall_health: UNKNOWN } } }
I20260811 11:48:11.273154 8431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:11.269462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52382 (local address 127.20.244.66:40787)
0811 11:48:11.269593 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:11.269597 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:11.269610 (+ 13us) server_negotiation.cc:407] Connection header received
0811 11:48:11.269725 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:11.269728 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:11.269844 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:11.269978 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:48:11.270264 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.270779 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.271696 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:11.271922 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:11.272025 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:11.272361 (+ 336us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:48:11.272777 (+ 416us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:48:11.272913 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:11.272954 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 11:48:11.273010 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 11:48:11.278882 8021 raft_consensus.cc:1261] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Refusing update from remote peer 72737f54fafa4addac27a299bc526914: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:48:11.278880 8360 raft_consensus.cc:1261] T b5a5f8b835b44e51ac5fed2027bf7944 P c6158cdf54e44739a475735c0e2a1fa0 [term 1 FOLLOWER]: Refusing update from remote peer 72737f54fafa4addac27a299bc526914: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:48:11.279627 8447 consensus_queue.cc:1035] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:48:11.279811 8442 consensus_queue.cc:1035] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:48:11.287381 8452 mvcc.cc:205] Tried to move back new op lower bound from 7317294658671345664 to 7317294658551926784. Current Snapshot: MvccSnapshot[applied={T|T < 7317294658671345664}]
I20260811 11:48:11.295876 7837 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49396:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:48:11.296018 7837 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49396:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:48:11.298291 7837 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e: Sending DeleteTablet for 3 replicas of tablet b5a5f8b835b44e51ac5fed2027bf7944
I20260811 11:48:11.299177 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 7915
I20260811 11:48:11.299177 8333 tablet_service.cc:1514] Processing DeleteTablet for tablet b5a5f8b835b44e51ac5fed2027bf7944 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:48:11 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:50206
I20260811 11:48:11.302125 8167 tablet_service.cc:1514] Processing DeleteTablet for tablet b5a5f8b835b44e51ac5fed2027bf7944 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:48:11 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:52374
I20260811 11:48:11.302867 8466 tablet_replica.cc:330] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914: stopping tablet replica
I20260811 11:48:11.303197 8466 raft_consensus.cc:2229] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:48:11.303546 8466 raft_consensus.cc:2258] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:48:11.304829 8466 ts_tablet_manager.cc:1905] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:48:11.306274 8463 tablet_replica.cc:330] T b5a5f8b835b44e51ac5fed2027bf7944 P c6158cdf54e44739a475735c0e2a1fa0: stopping tablet replica
I20260811 11:48:11.306763 8463 raft_consensus.cc:2229] T b5a5f8b835b44e51ac5fed2027bf7944 P c6158cdf54e44739a475735c0e2a1fa0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:48:11.307212 8466 ts_tablet_manager.cc:1918] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:48:11.307230 8463 raft_consensus.cc:2258] T b5a5f8b835b44e51ac5fed2027bf7944 P c6158cdf54e44739a475735c0e2a1fa0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:48:11.307314 8466 log.cc:1196] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/b5a5f8b835b44e51ac5fed2027bf7944
I20260811 11:48:11.307749 8466 ts_tablet_manager.cc:1939] T b5a5f8b835b44e51ac5fed2027bf7944 P 72737f54fafa4addac27a299bc526914: Deleting consensus metadata
I20260811 11:48:11.308988 7819 catalog_manager.cc:4841] TS 72737f54fafa4addac27a299bc526914 (127.20.244.66:40787): tablet b5a5f8b835b44e51ac5fed2027bf7944 (table test-table [id=0e3c3c26e0f549699650a0cc258d507f]) successfully deleted
I20260811 11:48:11.309113 8463 ts_tablet_manager.cc:1905] T b5a5f8b835b44e51ac5fed2027bf7944 P c6158cdf54e44739a475735c0e2a1fa0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:48:11.311914 8463 ts_tablet_manager.cc:1918] T b5a5f8b835b44e51ac5fed2027bf7944 P c6158cdf54e44739a475735c0e2a1fa0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:48:11.312026 8463 log.cc:1196] T b5a5f8b835b44e51ac5fed2027bf7944 P c6158cdf54e44739a475735c0e2a1fa0: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/b5a5f8b835b44e51ac5fed2027bf7944
I20260811 11:48:11.312433 8463 ts_tablet_manager.cc:1939] T b5a5f8b835b44e51ac5fed2027bf7944 P c6158cdf54e44739a475735c0e2a1fa0: Deleting consensus metadata
W20260811 11:48:11.313961 7819 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.244.65:46533 (error 108)
I20260811 11:48:11.314237 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 8082
I20260811 11:48:11.317725 8433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:11.317360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:46533 (local address 127.0.0.1:48542)
0811 11:48:11.317522 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:11.317632 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.65:46533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260811 11:48:11.317926 7819 catalog_manager.cc:4584] TS 546aa53b59de4776a6c70558f49b4d2e (127.20.244.65:46533): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b5a5f8b835b44e51ac5fed2027bf7944: Network error: Client connection negotiation failed: client connection to 127.20.244.65:46533: connect: Connection refused (error 111)
I20260811 11:48:11.313930 7817 catalog_manager.cc:4841] TS c6158cdf54e44739a475735c0e2a1fa0 (127.20.244.67:33909): tablet b5a5f8b835b44e51ac5fed2027bf7944 (table test-table [id=0e3c3c26e0f549699650a0cc258d507f]) successfully deleted
I20260811 11:48:11.323444 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 8253
I20260811 11:48:11.332027 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 7798
I20260811 11:48:31.342995 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:39665
--webserver_interface=127.20.244.126
--webserver_port=45067
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:43143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:39665
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:48:31.459182 8468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:48:31.459471 8468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:48:31.459513 8468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:48:31.463610 8468 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 11:48:31.463672 8468 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 11:48:31.463689 8468 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 11:48:31.463703 8468 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:48:31.463721 8468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:48:31.463739 8468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:48:31.463810 8468 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:48:31.463833 8468 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:48:31.469238 8468 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:43143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:39665
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:39665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=45067
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:48:31.470352 8468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:48:31.471421 8468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:48:31.486027 8479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:48:31.486061 8477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:48:31.486132 8468 server_base.cc:1034] running on GCE node
W20260811 11:48:31.486061 8476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:48:31.486932 8468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:48:31.488180 8468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:48:31.489347 8468 hybrid_clock.cc:648] HybridClock initialized: now 1786448911489310 us; error 53 us; skew 500 ppm
Aug 11 11:48:31 dist-test-slave-vkjp krb5kdc[7783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448911, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:48:31.498556 8468 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:48:31.499676 8468 webserver.cc:460] Webserver started at http://127.20.244.126:45067/ using document root <none> and password file <none>
I20260811 11:48:31.500286 8468 fs_manager.cc:359] Metadata directory not provided
I20260811 11:48:31.500360 8468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:48:31.504427 8468 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 11:48:31.506570 8489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:31.507917 8468 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:48:31.508072 8468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "8852f95e54dc44bbb5e598a2be64eb3e"
format_stamp: "Formatted at 2026-08-11 11:48:10 on dist-test-slave-vkjp"
server_key: "d7fc853a139f8932cde469dd3413f0d0"
server_key_iv: "ab8bc27bcf28d88ffff470f93f877892"
server_key_version: "encryptionkey@0"
I20260811 11:48:31.508697 8468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:48:31.525216 8468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:48:31.528518 8468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:48:31.528740 8468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:48:31.536547 8468 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:39665
I20260811 11:48:31.536921 8549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:39665 every 8 connection(s)
I20260811 11:48:31.537743 8468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:48:31.541234 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 8468
I20260811 11:48:31.541785 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:46533
--local_ip_for_outbound_sockets=127.20.244.65
--tserver_master_addrs=127.20.244.126:39665
--webserver_port=36391
--webserver_interface=127.20.244.65
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:43143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:48:31.543135 8550 sys_catalog.cc:263] Verifying existing consensus state
I20260811 11:48:31.545241 8550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e: Bootstrap starting.
I20260811 11:48:31.564644 8550 log.cc:824] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e: Log is configured to *not* fsync() on all Append() calls
I20260811 11:48:31.574189 8550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:48:31.574637 8550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e: Bootstrap complete.
I20260811 11:48:31.579324 8550 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39665 } }
I20260811 11:48:31.579769 8550 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8852f95e54dc44bbb5e598a2be64eb3e, State: Initialized, Role: FOLLOWER
I20260811 11:48:31.580355 8550 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39665 } }
I20260811 11:48:31.580497 8550 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:48:31.580598 8550 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:48:31.580721 8550 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 1 FOLLOWER]: Advancing to term 2
I20260811 11:48:31.582885 8550 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39665 } }
I20260811 11:48:31.583299 8550 leader_election.cc:302] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8852f95e54dc44bbb5e598a2be64eb3e; no voters:
I20260811 11:48:31.583693 8550 leader_election.cc:288] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 11:48:31.583804 8554 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 2 FOLLOWER]: Leader election won for term 2
I20260811 11:48:31.584034 8554 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 2 LEADER]: Becoming Leader. State: Replica: 8852f95e54dc44bbb5e598a2be64eb3e, State: Running, Role: LEADER
I20260811 11:48:31.584450 8554 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39665 } }
I20260811 11:48:31.585114 8550 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:48:31.586135 8555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39665 } } }
I20260811 11:48:31.586295 8555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [sys.catalog]: This master's current role is: LEADER
I20260811 11:48:31.586654 8556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8852f95e54dc44bbb5e598a2be64eb3e. Latest consensus state: current_term: 2 leader_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39665 } } }
I20260811 11:48:31.586776 8556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [sys.catalog]: This master's current role is: LEADER
I20260811 11:48:31.588498 8564 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:48:31.594785 8564 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:48:31.595628 8564 catalog_manager.cc:1259] Loaded cluster ID: ca16085ff7cf4d9a91a1d53d18c57aee
I20260811 11:48:31.595754 8564 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:48:31.598737 8564 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:48:31.600173 8564 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e: Loaded TSK: 0
I20260811 11:48:31.617776 8564 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e: Generated new TSK 1
I20260811 11:48:31.618094 8564 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 11:48:31.669509 8552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:48:31.669819 8552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:48:31.669894 8552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:48:31.674008 8552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:48:31.674113 8552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:48:31.674209 8552 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:48:31.679658 8552 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:43143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:46533
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=36391
--tserver_master_addrs=127.20.244.126:39665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8552
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:48:31.680783 8552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:48:31.681871 8552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:48:31.692523 8585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:48:31.692533 8586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:48:31.692626 8588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:48:31.693480 8552 server_base.cc:1034] running on GCE node
I20260811 11:48:31.693888 8552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:48:31.694581 8552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:48:31.695760 8552 hybrid_clock.cc:648] HybridClock initialized: now 1786448911695736 us; error 41 us; skew 500 ppm
Aug 11 11:48:31 dist-test-slave-vkjp krb5kdc[7783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448911, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:48:31.698794 8552 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:48:31.699968 8552 webserver.cc:460] Webserver started at http://127.20.244.65:36391/ using document root <none> and password file <none>
I20260811 11:48:31.700668 8552 fs_manager.cc:359] Metadata directory not provided
I20260811 11:48:31.700768 8552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:48:31.705817 8552 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 11:48:31.708503 8595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:31.710021 8552 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 11:48:31.710141 8552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "546aa53b59de4776a6c70558f49b4d2e"
format_stamp: "Formatted at 2026-08-11 11:48:10 on dist-test-slave-vkjp"
server_key: "c8616358b54fc32463f5a2c6346ffe73"
server_key_iv: "de8563c4d20837e7651e1a3d22e100c4"
server_key_version: "encryptionkey@0"
I20260811 11:48:31.710915 8552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:48:31.740862 8552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:48:31.745146 8552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:48:31.745362 8552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:48:31.746163 8552 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:48:31.747582 8603 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 11:48:31.752198 8552 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 11:48:31.752278 8552 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260811 11:48:31.752345 8552 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 11:48:31.754469 8552 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 11:48:31.754525 8552 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260811 11:48:31.754941 8603 tablet_bootstrap.cc:492] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e: Bootstrap starting.
I20260811 11:48:31.764611 8552 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:46533
I20260811 11:48:31.764976 8733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:46533 every 8 connection(s)
I20260811 11:48:31.765974 8552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:48:31.770315 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 8552
I20260811 11:48:31.770954 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:40787
--local_ip_for_outbound_sockets=127.20.244.66
--tserver_master_addrs=127.20.244.126:39665
--webserver_port=42035
--webserver_interface=127.20.244.66
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:43143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:48:31.776571 8603 log.cc:824] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e: Log is configured to *not* fsync() on all Append() calls
Aug 11 11:48:31 dist-test-slave-vkjp krb5kdc[7783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448911, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:48:31.783739 8736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:31.768202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:46551 (local address 127.20.244.126:39665)
0811 11:48:31.768624 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:31.768644 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:31.768925 (+ 281us) server_negotiation.cc:407] Connection header received
0811 11:48:31.770019 (+ 1094us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:31.770028 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:31.770306 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:31.770674 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:48:31.771969 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:31.773007 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:31.774865 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:31.775422 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:31.775603 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:31.778395 (+ 2792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:48:31.778400 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:48:31.778413 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:48:31.778442 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:48:31.780367 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:31.781034 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:31.781040 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:31.781045 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:31.781189 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:31.781554 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:31.781557 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:31.781559 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:31.781914 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:48:31.782061 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:31.782579 (+ 518us) server_negotiation.cc:299] Negotiation successful
0811 11:48:31.782833 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":133,"threads_started":1}
I20260811 11:48:31.783752 8737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:31.768212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.65:46551)
0811 11:48:31.768735 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:31.768787 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 11:48:31.769602 (+ 815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:48:31.770728 (+ 1126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:48:31.770736 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:48:31.771286 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:48:31.771776 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:31.771790 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:31.773192 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:31.773196 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:31.774722 (+ 1526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:31.774735 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:31.775559 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:31.775563 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:31.775762 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:31.776423 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:48:31.776439 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:48:31.778183 (+ 1744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:48:31.780510 (+ 2327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:48:31.780516 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:48:31.780529 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:48:31.780883 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:48:31.781294 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:48:31.781297 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:48:31.781299 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:48:31.781445 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:48:31.782034 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:48:31.782040 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:48:31.782276 (+ 236us) client_negotiation.cc:769] Sending connection context
0811 11:48:31.782464 (+ 188us) client_negotiation.cc:240] Negotiation successful
0811 11:48:31.782799 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":145,"threads_started":1}
I20260811 11:48:31.786343 8734 heartbeater.cc:347] Connected to a master server at 127.20.244.126:39665
I20260811 11:48:31.786585 8734 heartbeater.cc:464] Registering TS with master...
I20260811 11:48:31.787009 8603 tablet_bootstrap.cc:492] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:48:31.787132 8734 heartbeater.cc:511] Master 127.20.244.126:39665 requested a full tablet report, sending...
I20260811 11:48:31.787499 8603 tablet_bootstrap.cc:492] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e: Bootstrap complete.
I20260811 11:48:31.788941 8603 ts_tablet_manager.cc:1397] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e: Time spent bootstrapping tablet: real 0.034s user 0.024s sys 0.008s
I20260811 11:48:31.789464 8508 ts_manager.cc:194] Registered new tserver with Master: 546aa53b59de4776a6c70558f49b4d2e (127.20.244.65:46533)
I20260811 11:48:31.791954 8603 raft_consensus.cc:348] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:31.792594 8603 raft_consensus.cc:729] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aa53b59de4776a6c70558f49b4d2e, State: Initialized, Role: FOLLOWER
I20260811 11:48:31.793126 8508 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:46551
I20260811 11:48:31.793211 8603 consensus_queue.cc:260] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:31.794384 8603 ts_tablet_manager.cc:1428] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 11:48:31.796257 8734 heartbeater.cc:503] Master 127.20.244.126:39665 was elected leader, sending a full tablet report...
I20260811 11:48:31.799445 8745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:31.793285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52656 (local address 127.20.244.65:46533)
0811 11:48:31.794906 (+ 1621us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:31.794918 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:31.794939 (+ 21us) server_negotiation.cc:407] Connection header received
0811 11:48:31.794999 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:31.795004 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:31.795390 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:31.795550 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:48:31.795926 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:31.796878 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:31.798067 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:31.798717 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:31.798847 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:31.798982 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:31.799215 (+ 233us) server_negotiation.cc:299] Negotiation successful
0811 11:48:31.799304 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1530,"thread_start_us":105,"threads_started":1}
I20260811 11:48:31.799458 8742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:31.792442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:46533 (local address 127.0.0.1:52656)
0811 11:48:31.794467 (+ 2025us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:31.794517 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 11:48:31.794645 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:48:31.795583 (+ 938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:48:31.795590 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:48:31.795621 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:48:31.795782 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:31.795791 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:31.796997 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:31.797002 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:31.797939 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:31.797949 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:31.798869 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:31.798873 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:31.798985 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:31.799031 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 11:48:31.799184 (+ 153us) client_negotiation.cc:240] Negotiation successful
0811 11:48:31.799327 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1792,"thread_start_us":174,"threads_started":1}
I20260811 11:48:31.800491 8655 tablet_service.cc:1514] Processing DeleteTablet for tablet b5a5f8b835b44e51ac5fed2027bf7944 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:48:11 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:52656
I20260811 11:48:31.801491 8748 tablet_replica.cc:330] stopping tablet replica
I20260811 11:48:31.801774 8748 raft_consensus.cc:2229] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:48:31.802018 8748 raft_consensus.cc:2258] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:48:31.802984 8748 ts_tablet_manager.cc:1905] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:48:31.806751 8748 ts_tablet_manager.cc:1918] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:48:31.806886 8748 log.cc:1196] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/wal/wals/b5a5f8b835b44e51ac5fed2027bf7944
I20260811 11:48:31.807245 8748 ts_tablet_manager.cc:1939] T b5a5f8b835b44e51ac5fed2027bf7944 P 546aa53b59de4776a6c70558f49b4d2e: Deleting consensus metadata
I20260811 11:48:31.808992 8494 catalog_manager.cc:4841] TS 546aa53b59de4776a6c70558f49b4d2e (127.20.244.65:46533): tablet b5a5f8b835b44e51ac5fed2027bf7944 (table test-table [id=0e3c3c26e0f549699650a0cc258d507f]) successfully deleted
W20260811 11:48:31.901994 8740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:48:31.902279 8740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:48:31.902324 8740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:48:31.906452 8740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:48:31.906534 8740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:48:31.906599 8740 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:48:31.912461 8740 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:43143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:40787
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=42035
--tserver_master_addrs=127.20.244.126:39665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8740
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:48:31.913704 8740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:48:31.914798 8740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:48:31.925277 8754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:48:31.925376 8757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:48:31.925297 8755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:48:31.925477 8740 server_base.cc:1034] running on GCE node
I20260811 11:48:31.926062 8740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:48:31.926803 8740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:48:31.928020 8740 hybrid_clock.cc:648] HybridClock initialized: now 1786448911927992 us; error 40 us; skew 500 ppm
Aug 11 11:48:31 dist-test-slave-vkjp krb5kdc[7783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448911, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:48:31.931290 8740 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:48:31.932363 8740 webserver.cc:460] Webserver started at http://127.20.244.66:42035/ using document root <none> and password file <none>
I20260811 11:48:31.932977 8740 fs_manager.cc:359] Metadata directory not provided
I20260811 11:48:31.933095 8740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:48:31.937266 8740 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 11:48:31.939608 8766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:31.940956 8740 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:48:31.941138 8740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "72737f54fafa4addac27a299bc526914"
format_stamp: "Formatted at 2026-08-11 11:48:10 on dist-test-slave-vkjp"
server_key: "09bde2628fc600fe0277899e8b06f265"
server_key_iv: "e55439db85f1520e93fe0de24557dfc9"
server_key_version: "encryptionkey@0"
I20260811 11:48:31.941737 8740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:48:31.958870 8740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:48:31.962252 8740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:48:31.962495 8740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:48:31.963176 8740 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:48:31.964064 8740 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:48:31.964139 8740 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:31.964213 8740 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:48:31.964263 8740 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:31.973543 8740 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:40787
I20260811 11:48:31.973562 8894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:40787 every 8 connection(s)
I20260811 11:48:31.974591 8740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:48:31.982125 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 8740
I20260811 11:48:31.982676 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:33909
--local_ip_for_outbound_sockets=127.20.244.67
--tserver_master_addrs=127.20.244.126:39665
--webserver_port=42905
--webserver_interface=127.20.244.67
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:43143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 11:48:31 dist-test-slave-vkjp krb5kdc[7783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448911, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:48:31.990126 8736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:31.976543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:41821 (local address 127.20.244.126:39665)
0811 11:48:31.976727 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:31.976732 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:31.977529 (+ 797us) server_negotiation.cc:407] Connection header received
0811 11:48:31.978928 (+ 1399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:31.978932 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:31.978991 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:31.979218 (+ 227us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:48:31.980433 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:31.980982 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:31.982182 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:31.982597 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:31.982726 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:31.985791 (+ 3065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:48:31.985795 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:48:31.985797 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:48:31.985822 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:48:31.987686 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:31.988222 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:31.988229 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:31.988234 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:31.988340 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:31.988728 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:31.988733 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:31.988736 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:31.989023 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:48:31.989148 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:31.989674 (+ 526us) server_negotiation.cc:299] Negotiation successful
0811 11:48:31.989851 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 11:48:31.990824 8900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:31.976889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.66:41821)
0811 11:48:31.977362 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:31.977406 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:48:31.978682 (+ 1276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:48:31.979360 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:48:31.979367 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:48:31.979752 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:48:31.980250 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:31.980264 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:31.981134 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:31.981137 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:31.982038 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:31.982048 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:31.982784 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:31.982791 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:31.983016 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:31.983733 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:48:31.983750 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:48:31.985576 (+ 1826us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:48:31.987808 (+ 2232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:48:31.987813 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:48:31.987827 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:48:31.988103 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:48:31.988477 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:48:31.988479 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:48:31.988480 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:48:31.988622 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:48:31.989141 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:48:31.989146 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:48:31.989395 (+ 249us) client_negotiation.cc:769] Sending connection context
0811 11:48:31.989577 (+ 182us) client_negotiation.cc:240] Negotiation successful
0811 11:48:31.989848 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":118,"threads_started":1}
I20260811 11:48:31.992381 8895 heartbeater.cc:347] Connected to a master server at 127.20.244.126:39665
I20260811 11:48:31.992647 8895 heartbeater.cc:464] Registering TS with master...
I20260811 11:48:31.993206 8895 heartbeater.cc:511] Master 127.20.244.126:39665 requested a full tablet report, sending...
I20260811 11:48:31.994436 8508 ts_manager.cc:194] Registered new tserver with Master: 72737f54fafa4addac27a299bc526914 (127.20.244.66:40787)
I20260811 11:48:31.995409 8508 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:41821
W20260811 11:48:32.102862 8901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:48:32.103157 8901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:48:32.103202 8901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:48:32.107159 8901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:48:32.107210 8901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:48:32.107267 8901 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:48:32.112717 8901 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:43143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:33909
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=42905
--tserver_master_addrs=127.20.244.126:39665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8901
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:48:32.113933 8901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:48:32.115000 8901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:48:32.125437 8901 server_base.cc:1034] running on GCE node
W20260811 11:48:32.125449 8907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:48:32.125401 8909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:48:32.125402 8914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:48:32.126133 8901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:48:32.126732 8901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:48:32.127923 8901 hybrid_clock.cc:648] HybridClock initialized: now 1786448912127902 us; error 30 us; skew 500 ppm
Aug 11 11:48:32 dist-test-slave-vkjp krb5kdc[7783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448912, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:48:32.130775 8901 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:48:32.131744 8901 webserver.cc:460] Webserver started at http://127.20.244.67:42905/ using document root <none> and password file <none>
I20260811 11:48:32.132272 8901 fs_manager.cc:359] Metadata directory not provided
I20260811 11:48:32.132345 8901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:48:32.136169 8901 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 11:48:32.138176 8921 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:32.139526 8901 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:48:32.139628 8901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "c6158cdf54e44739a475735c0e2a1fa0"
format_stamp: "Formatted at 2026-08-11 11:48:11 on dist-test-slave-vkjp"
server_key: "e38db30d1b2c0a32e6bb46e29ecd12cd"
server_key_iv: "c0a3a194b8fc6ddb7f33977f7ea1cdaa"
server_key_version: "encryptionkey@0"
I20260811 11:48:32.140192 8901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:48:32.150614 8901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:48:32.153864 8901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:48:32.154086 8901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:48:32.154681 8901 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:48:32.155586 8901 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:48:32.155658 8901 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:32.155730 8901 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:48:32.155781 8901 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:32.164453 8901 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:33909
I20260811 11:48:32.164543 9050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:33909 every 8 connection(s)
I20260811 11:48:32.165509 8901 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:48:32.171826 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 8901
Aug 11 11:48:32 dist-test-slave-vkjp krb5kdc[7783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448912, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:48:32.179939 8736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:32.167434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:35831 (local address 127.20.244.126:39665)
0811 11:48:32.167583 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:32.167587 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:32.168417 (+ 830us) server_negotiation.cc:407] Connection header received
0811 11:48:32.169759 (+ 1342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:32.169762 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:32.169825 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:32.169932 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:48:32.171152 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.171689 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.173155 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.173397 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.173511 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:32.176009 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:48:32.176013 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:48:32.176018 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:48:32.176051 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:48:32.177670 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:32.178360 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:32.178364 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:32.178366 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:32.178451 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:32.178808 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:32.178813 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:32.178817 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:32.179007 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:48:32.179138 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:32.179644 (+ 506us) server_negotiation.cc:299] Negotiation successful
0811 11:48:32.179771 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 11:48:32.180356 9055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:32.172534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48202 (local address 127.20.244.126:39665)
0811 11:48:32.172759 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:32.172765 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:32.172948 (+ 183us) server_negotiation.cc:407] Connection header received
0811 11:48:32.173107 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:32.173110 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:32.173156 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:32.173253 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:48:32.173991 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.174508 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.175442 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.175726 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.175836 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:32.177197 (+ 1361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:48:32.177201 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:48:32.177204 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:48:32.177247 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:48:32.178638 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:32.179076 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:32.179095 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:32.179100 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:32.179190 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:32.179479 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:32.179486 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:32.179489 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:32.179663 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:48:32.179893 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:32.180066 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 11:48:32.180189 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":75,"threads_started":1}
I20260811 11:48:32.181365 9054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:32.167806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.67:35831)
0811 11:48:32.168235 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:32.168275 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 11:48:32.169533 (+ 1258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:48:32.170129 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:48:32.170135 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:48:32.170503 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:48:32.170969 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:32.170982 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.171825 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.171829 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:32.173018 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:32.173029 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.173549 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.173554 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:32.173728 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:32.174323 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:48:32.174341 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:48:32.175843 (+ 1502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:48:32.177813 (+ 1970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:48:32.177819 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:48:32.177834 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:48:32.178247 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:48:32.178547 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:48:32.178553 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:48:32.178555 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:48:32.178708 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:48:32.179131 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:48:32.179137 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:48:32.179403 (+ 266us) client_negotiation.cc:769] Sending connection context
0811 11:48:32.179601 (+ 198us) client_negotiation.cc:240] Negotiation successful
0811 11:48:32.179944 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":112,"threads_started":1}
I20260811 11:48:32.182577 9052 heartbeater.cc:347] Connected to a master server at 127.20.244.126:39665
I20260811 11:48:32.182819 9052 heartbeater.cc:464] Registering TS with master...
I20260811 11:48:32.183434 9052 heartbeater.cc:511] Master 127.20.244.126:39665 requested a full tablet report, sending...
I20260811 11:48:32.184469 8509 ts_manager.cc:194] Registered new tserver with Master: c6158cdf54e44739a475735c0e2a1fa0 (127.20.244.67:33909)
I20260811 11:48:32.185070 8509 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:35831
I20260811 11:48:32.194192 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:48:32.198590 9055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:32.194860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48214 (local address 127.20.244.126:39665)
0811 11:48:32.194996 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:32.195000 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:32.195280 (+ 280us) server_negotiation.cc:407] Connection header received
0811 11:48:32.195430 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:32.195433 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:32.195588 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:32.195675 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:48:32.195914 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.196420 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.197428 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.197679 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.197762 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:32.198128 (+ 366us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:48:32.198268 (+ 140us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 11:48:32.198489 (+ 221us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48214: token expired
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 11:48:32.198686 9055 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48214: token expired
W20260811 11:48:32.199124 8420 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.20.244.126:39665)
I20260811 11:48:32.206383 9055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:32.199573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48230 (local address 127.20.244.126:39665)
0811 11:48:32.199695 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:32.199699 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:32.199712 (+ 13us) server_negotiation.cc:407] Connection header received
0811 11:48:32.199830 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:32.199832 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:32.199867 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:32.199931 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:48:32.200612 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.201111 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.201916 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.202125 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.202199 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:32.203641 (+ 1442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:48:32.203644 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:48:32.203646 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:48:32.203665 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:48:32.204936 (+ 1271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:32.205361 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:32.205364 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:32.205365 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:32.205438 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:32.205669 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:32.205671 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:32.205672 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:32.205872 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:48:32.205989 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:32.206173 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 11:48:32.206264 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 11:48:32.208951 8509 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48230:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:48:32.212296 8509 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:48:32.221509 8655 tablet_service.cc:1467] Processing CreateTablet for tablet e4cf85f67bdd46c4896a4c813393b57a (DEFAULT_TABLE table=test-table [id=6ace2c0233a44d9ca2a435cf1cf750ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:48:32.222210 8655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4cf85f67bdd46c4896a4c813393b57a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:48:32.225028 8603 tablet_bootstrap.cc:492] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e: Bootstrap starting.
I20260811 11:48:32.226002 8603 tablet_bootstrap.cc:654] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e: Neither blocks nor log segments found. Creating new log.
I20260811 11:48:32.226200 8742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:32.219593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:33909 (local address 127.0.0.1:53802)
0811 11:48:32.219748 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:32.219763 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:48:32.219848 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:48:32.221146 (+ 1298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:48:32.221150 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:48:32.221174 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:48:32.221320 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:32.221331 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.222800 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.222808 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:32.224018 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:32.224033 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.225561 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.225572 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:32.225766 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:32.225804 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 11:48:32.225911 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 11:48:32.226012 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 11:48:32.226225 9061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:32.220007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53802 (local address 127.20.244.67:33909)
0811 11:48:32.220447 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:32.220459 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:32.220485 (+ 26us) server_negotiation.cc:407] Connection header received
0811 11:48:32.220606 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:32.220613 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:32.220893 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:32.221181 (+ 288us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:48:32.221457 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.222654 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.224202 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.225351 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.225470 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:32.225625 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:32.225952 (+ 327us) server_negotiation.cc:299] Negotiation successful
0811 11:48:32.226078 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":163,"threads_started":1}
I20260811 11:48:32.228780 8603 tablet_bootstrap.cc:492] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e: No bootstrap required, opened a new log
I20260811 11:48:32.228919 8603 ts_tablet_manager.cc:1397] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 11:48:32.229359 8603 raft_consensus.cc:348] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:32.229507 8603 raft_consensus.cc:374] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:48:32.229570 8603 raft_consensus.cc:729] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aa53b59de4776a6c70558f49b4d2e, State: Initialized, Role: FOLLOWER
I20260811 11:48:32.229769 8603 consensus_queue.cc:260] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:32.230126 8603 ts_tablet_manager.cc:1428] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:48:32.229696 8974 tablet_service.cc:1467] Processing CreateTablet for tablet e4cf85f67bdd46c4896a4c813393b57a (DEFAULT_TABLE table=test-table [id=6ace2c0233a44d9ca2a435cf1cf750ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:48:32.230919 8974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4cf85f67bdd46c4896a4c813393b57a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:48:32.233171 9063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:32.220490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:40787 (local address 127.0.0.1:60390)
0811 11:48:32.220741 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:32.220754 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:48:32.220845 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:48:32.228225 (+ 7380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:48:32.228231 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:48:32.228271 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:48:32.228413 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:32.228422 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.229813 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.229817 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:32.231157 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:32.231171 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.232712 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.232720 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:32.232834 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:32.232865 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 11:48:32.232958 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 11:48:32.233048 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":104,"threads_started":1}
I20260811 11:48:32.233680 9064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:32.220695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60390 (local address 127.20.244.66:40787)
0811 11:48:32.227698 (+ 7003us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:32.227710 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:32.227737 (+ 27us) server_negotiation.cc:407] Connection header received
0811 11:48:32.227815 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:32.227820 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:32.228033 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:32.228200 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:48:32.228564 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.229652 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.231349 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.232333 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.232458 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:32.232632 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:32.233423 (+ 791us) server_negotiation.cc:299] Negotiation successful
0811 11:48:32.233544 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6884,"thread_start_us":160,"threads_started":1}
I20260811 11:48:32.236793 8819 tablet_service.cc:1467] Processing CreateTablet for tablet e4cf85f67bdd46c4896a4c813393b57a (DEFAULT_TABLE table=test-table [id=6ace2c0233a44d9ca2a435cf1cf750ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:48:32.237931 8819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4cf85f67bdd46c4896a4c813393b57a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:48:32.238956 9066 tablet_bootstrap.cc:492] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0: Bootstrap starting.
I20260811 11:48:32.241540 9066 tablet_bootstrap.cc:654] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0: Neither blocks nor log segments found. Creating new log.
I20260811 11:48:32.242659 9066 log.cc:824] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0: Log is configured to *not* fsync() on all Append() calls
I20260811 11:48:32.244707 9066 tablet_bootstrap.cc:492] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0: No bootstrap required, opened a new log
I20260811 11:48:32.244942 9066 ts_tablet_manager.cc:1397] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 11:48:32.245296 9068 tablet_bootstrap.cc:492] T e4cf85f67bdd46c4896a4c813393b57a P 72737f54fafa4addac27a299bc526914: Bootstrap starting.
I20260811 11:48:32.248247 9068 tablet_bootstrap.cc:654] T e4cf85f67bdd46c4896a4c813393b57a P 72737f54fafa4addac27a299bc526914: Neither blocks nor log segments found. Creating new log.
I20260811 11:48:32.249145 9068 log.cc:824] T e4cf85f67bdd46c4896a4c813393b57a P 72737f54fafa4addac27a299bc526914: Log is configured to *not* fsync() on all Append() calls
I20260811 11:48:32.249189 9066 raft_consensus.cc:348] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:32.249516 9066 raft_consensus.cc:374] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:48:32.249598 9066 raft_consensus.cc:729] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6158cdf54e44739a475735c0e2a1fa0, State: Initialized, Role: FOLLOWER
I20260811 11:48:32.250032 9066 consensus_queue.cc:260] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:32.250818 9052 heartbeater.cc:503] Master 127.20.244.126:39665 was elected leader, sending a full tablet report...
I20260811 11:48:32.251221 9066 ts_tablet_manager.cc:1428] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0: Time spent starting tablet: real 0.006s user 0.007s sys 0.001s
I20260811 11:48:32.251550 9068 tablet_bootstrap.cc:492] T e4cf85f67bdd46c4896a4c813393b57a P 72737f54fafa4addac27a299bc526914: No bootstrap required, opened a new log
I20260811 11:48:32.251715 9068 ts_tablet_manager.cc:1397] T e4cf85f67bdd46c4896a4c813393b57a P 72737f54fafa4addac27a299bc526914: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260811 11:48:32.255061 9068 raft_consensus.cc:348] T e4cf85f67bdd46c4896a4c813393b57a P 72737f54fafa4addac27a299bc526914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:32.255354 9068 raft_consensus.cc:374] T e4cf85f67bdd46c4896a4c813393b57a P 72737f54fafa4addac27a299bc526914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:48:32.255390 9068 raft_consensus.cc:729] T e4cf85f67bdd46c4896a4c813393b57a P 72737f54fafa4addac27a299bc526914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72737f54fafa4addac27a299bc526914, State: Initialized, Role: FOLLOWER
I20260811 11:48:32.255733 9068 consensus_queue.cc:260] T e4cf85f67bdd46c4896a4c813393b57a P 72737f54fafa4addac27a299bc526914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:32.256367 8895 heartbeater.cc:503] Master 127.20.244.126:39665 was elected leader, sending a full tablet report...
I20260811 11:48:32.256508 9068 ts_tablet_manager.cc:1428] T e4cf85f67bdd46c4896a4c813393b57a P 72737f54fafa4addac27a299bc526914: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
W20260811 11:48:32.267532 8735 tablet.cc:2369] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:48:32.416550 9053 tablet.cc:2369] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:48:32.462952 9071 raft_consensus.cc:482] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:48:32.463268 9071 raft_consensus.cc:504] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:32.464453 9071 leader_election.cc:288] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72737f54fafa4addac27a299bc526914 (127.20.244.66:40787), 546aa53b59de4776a6c70558f49b4d2e (127.20.244.65:46533)
I20260811 11:48:32.468168 9064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:32.464869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:50381 (local address 127.20.244.66:40787)
0811 11:48:32.465015 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:32.465021 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:32.465038 (+ 17us) server_negotiation.cc:407] Connection header received
0811 11:48:32.465209 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:32.465211 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:32.465254 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:32.465349 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:48:32.465641 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.466147 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.467200 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.467596 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.467728 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:32.467783 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:32.467974 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 11:48:32.468042 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 11:48:32.468168 9054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:32.464789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:40787 (local address 127.20.244.67:50381)
0811 11:48:32.464944 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:32.464970 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 11:48:32.465076 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:48:32.465363 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:48:32.465366 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:48:32.465384 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:48:32.465520 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:32.465526 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.466258 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.466263 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:32.467042 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:32.467051 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.467723 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.467727 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:32.467836 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:32.467858 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 11:48:32.467957 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 11:48:32.468037 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 11:48:32.468834 8844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4cf85f67bdd46c4896a4c813393b57a" candidate_uuid: "c6158cdf54e44739a475735c0e2a1fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72737f54fafa4addac27a299bc526914" is_pre_election: true
I20260811 11:48:32.468922 9073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:32.465122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:46533 (local address 127.20.244.67:41423)
0811 11:48:32.465576 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:32.465591 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:48:32.465723 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:48:32.466014 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:48:32.466016 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:48:32.466032 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:48:32.466152 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:32.466158 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.466879 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.466886 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:32.467739 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:32.467749 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.468480 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.468483 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:32.468598 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:32.468621 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 11:48:32.468722 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 11:48:32.468790 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":134,"threads_started":1}
I20260811 11:48:32.468942 9074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:32.465245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:41423 (local address 127.20.244.65:46533)
0811 11:48:32.465558 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:32.465562 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:32.465687 (+ 125us) server_negotiation.cc:407] Connection header received
0811 11:48:32.465845 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:32.465848 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:32.465903 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:32.466003 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:48:32.466270 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.466764 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.467882 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.468357 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.468474 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:32.468521 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:32.468746 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 11:48:32.468821 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":61,"threads_started":1}
I20260811 11:48:32.469206 8844 raft_consensus.cc:2454] T e4cf85f67bdd46c4896a4c813393b57a P 72737f54fafa4addac27a299bc526914 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6158cdf54e44739a475735c0e2a1fa0 in term 0.
I20260811 11:48:32.469532 8679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4cf85f67bdd46c4896a4c813393b57a" candidate_uuid: "c6158cdf54e44739a475735c0e2a1fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aa53b59de4776a6c70558f49b4d2e" is_pre_election: true
I20260811 11:48:32.469743 8924 leader_election.cc:302] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72737f54fafa4addac27a299bc526914, c6158cdf54e44739a475735c0e2a1fa0; no voters:
I20260811 11:48:32.469884 8679 raft_consensus.cc:2454] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6158cdf54e44739a475735c0e2a1fa0 in term 0.
I20260811 11:48:32.470098 9071 raft_consensus.cc:2781] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:48:32.470196 9071 raft_consensus.cc:482] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:48:32.470255 9071 raft_consensus.cc:3037] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:48:32.471343 9071 raft_consensus.cc:504] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:32.471696 9071 leader_election.cc:288] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0 [CANDIDATE]: Term 1 election: Requested vote from peers 72737f54fafa4addac27a299bc526914 (127.20.244.66:40787), 546aa53b59de4776a6c70558f49b4d2e (127.20.244.65:46533)
I20260811 11:48:32.472062 8844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4cf85f67bdd46c4896a4c813393b57a" candidate_uuid: "c6158cdf54e44739a475735c0e2a1fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72737f54fafa4addac27a299bc526914"
I20260811 11:48:32.472122 8679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4cf85f67bdd46c4896a4c813393b57a" candidate_uuid: "c6158cdf54e44739a475735c0e2a1fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aa53b59de4776a6c70558f49b4d2e"
I20260811 11:48:32.472182 8844 raft_consensus.cc:3037] T e4cf85f67bdd46c4896a4c813393b57a P 72737f54fafa4addac27a299bc526914 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:48:32.472282 8679 raft_consensus.cc:3037] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:48:32.473268 8844 raft_consensus.cc:2454] T e4cf85f67bdd46c4896a4c813393b57a P 72737f54fafa4addac27a299bc526914 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6158cdf54e44739a475735c0e2a1fa0 in term 1.
I20260811 11:48:32.473413 8679 raft_consensus.cc:2454] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6158cdf54e44739a475735c0e2a1fa0 in term 1.
I20260811 11:48:32.473639 8924 leader_election.cc:302] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72737f54fafa4addac27a299bc526914, c6158cdf54e44739a475735c0e2a1fa0; no voters:
I20260811 11:48:32.473804 9071 raft_consensus.cc:2781] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:48:32.474045 9071 raft_consensus.cc:686] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0 [term 1 LEADER]: Becoming Leader. State: Replica: c6158cdf54e44739a475735c0e2a1fa0, State: Running, Role: LEADER
I20260811 11:48:32.474393 9071 consensus_queue.cc:237] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
W20260811 11:48:32.476814 8896 tablet.cc:2369] T e4cf85f67bdd46c4896a4c813393b57a P 72737f54fafa4addac27a299bc526914: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:48:32.477784 8508 catalog_manager.cc:5495] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6158cdf54e44739a475735c0e2a1fa0 (127.20.244.67). New cstate: current_term: 1 leader_uuid: "c6158cdf54e44739a475735c0e2a1fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } health_report { overall_health: UNKNOWN } } }
I20260811 11:48:32.525346 9061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:32.521596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53812 (local address 127.20.244.67:33909)
0811 11:48:32.521845 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:32.521849 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:32.521864 (+ 15us) server_negotiation.cc:407] Connection header received
0811 11:48:32.522005 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:32.522008 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:32.522066 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:32.522185 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:48:32.522433 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.522933 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.523830 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:32.524063 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:32.524179 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:32.524501 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:48:32.524925 (+ 424us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:48:32.525071 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:32.525136 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 11:48:32.525196 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155}
I20260811 11:48:32.531454 8844 raft_consensus.cc:1261] T e4cf85f67bdd46c4896a4c813393b57a P 72737f54fafa4addac27a299bc526914 [term 1 FOLLOWER]: Refusing update from remote peer c6158cdf54e44739a475735c0e2a1fa0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:48:32.531450 8679 raft_consensus.cc:1261] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Refusing update from remote peer c6158cdf54e44739a475735c0e2a1fa0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:48:32.532205 9071 consensus_queue.cc:1035] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:48:32.532444 9075 consensus_queue.cc:1035] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:48:32.538153 9080 mvcc.cc:205] Tried to move back new op lower bound from 7317294745721176064 to 7317294745497567232. Current Snapshot: MvccSnapshot[applied={T|T < 7317294745721176064}]
I20260811 11:48:32.540719 9081 mvcc.cc:205] Tried to move back new op lower bound from 7317294745721176064 to 7317294745497567232. Current Snapshot: MvccSnapshot[applied={T|T < 7317294745721176064}]
I20260811 11:48:32.541394 9082 mvcc.cc:205] Tried to move back new op lower bound from 7317294745721176064 to 7317294745497567232. Current Snapshot: MvccSnapshot[applied={T|T < 7317294745721176064}]
I20260811 11:48:32.551740 8509 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48230:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:48:32.551944 8509 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48230:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:48:32.554489 8509 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e: Sending DeleteTablet for 3 replicas of tablet e4cf85f67bdd46c4896a4c813393b57a
I20260811 11:48:32.555382 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 8552
I20260811 11:48:32.555315 8974 tablet_service.cc:1514] Processing DeleteTablet for tablet e4cf85f67bdd46c4896a4c813393b57a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:48:32 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:53802
I20260811 11:48:32.555598 8819 tablet_service.cc:1514] Processing DeleteTablet for tablet e4cf85f67bdd46c4896a4c813393b57a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:48:32 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:60390
I20260811 11:48:32.557606 9090 tablet_replica.cc:330] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0: stopping tablet replica
I20260811 11:48:32.558030 9090 raft_consensus.cc:2229] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:48:32.558476 9090 raft_consensus.cc:2258] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:48:32.560845 9090 ts_tablet_manager.cc:1905] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:48:32.563341 9091 tablet_replica.cc:330] T e4cf85f67bdd46c4896a4c813393b57a P 72737f54fafa4addac27a299bc526914: stopping tablet replica
I20260811 11:48:32.563733 9091 raft_consensus.cc:2229] T e4cf85f67bdd46c4896a4c813393b57a P 72737f54fafa4addac27a299bc526914 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:48:32.563781 9090 ts_tablet_manager.cc:1918] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:48:32.563880 9090 log.cc:1196] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/e4cf85f67bdd46c4896a4c813393b57a
I20260811 11:48:32.564121 9091 raft_consensus.cc:2258] T e4cf85f67bdd46c4896a4c813393b57a P 72737f54fafa4addac27a299bc526914 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:48:32.564226 9090 ts_tablet_manager.cc:1939] T e4cf85f67bdd46c4896a4c813393b57a P c6158cdf54e44739a475735c0e2a1fa0: Deleting consensus metadata
I20260811 11:48:32.565500 8490 catalog_manager.cc:4841] TS c6158cdf54e44739a475735c0e2a1fa0 (127.20.244.67:33909): tablet e4cf85f67bdd46c4896a4c813393b57a (table test-table [id=6ace2c0233a44d9ca2a435cf1cf750ad]) successfully deleted
I20260811 11:48:32.565626 9091 ts_tablet_manager.cc:1905] T e4cf85f67bdd46c4896a4c813393b57a P 72737f54fafa4addac27a299bc526914: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 11:48:32.568813 8494 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.244.65:46533 (error 108)
I20260811 11:48:32.569085 9091 ts_tablet_manager.cc:1918] T e4cf85f67bdd46c4896a4c813393b57a P 72737f54fafa4addac27a299bc526914: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:48:32.569190 9091 log.cc:1196] T e4cf85f67bdd46c4896a4c813393b57a P 72737f54fafa4addac27a299bc526914: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/e4cf85f67bdd46c4896a4c813393b57a
I20260811 11:48:32.569561 9091 ts_tablet_manager.cc:1939] T e4cf85f67bdd46c4896a4c813393b57a P 72737f54fafa4addac27a299bc526914: Deleting consensus metadata
W20260811 11:48:32.570225 9063 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:48:32.569915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:46533 (local address 127.0.0.1:52664)
0811 11:48:32.570060 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:32.570135 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.65:46533: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 11:48:32.570369 8494 catalog_manager.cc:4584] TS 546aa53b59de4776a6c70558f49b4d2e (127.20.244.65:46533): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e4cf85f67bdd46c4896a4c813393b57a: Network error: Client connection negotiation failed: client connection to 127.20.244.65:46533: connect: Connection reset by peer (error 104)
I20260811 11:48:32.570783 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 8740
I20260811 11:48:32.570899 8494 catalog_manager.cc:4841] TS 72737f54fafa4addac27a299bc526914 (127.20.244.66:40787): tablet e4cf85f67bdd46c4896a4c813393b57a (table test-table [id=6ace2c0233a44d9ca2a435cf1cf750ad]) successfully deleted
I20260811 11:48:32.580365 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 8901
I20260811 11:48:32.590777 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 8468
I20260811 11:48:52.599854 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:39665
--webserver_interface=127.20.244.126
--webserver_port=45067
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:43143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:39665
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:48:52.721246 9093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:48:52.721547 9093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:48:52.721587 9093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:48:52.725834 9093 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 11:48:52.725903 9093 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 11:48:52.725919 9093 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 11:48:52.725934 9093 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:48:52.725952 9093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:48:52.725997 9093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:48:52.726030 9093 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:48:52.726050 9093 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:48:52.731709 9093 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:43143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:39665
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:39665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=45067
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9093
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:48:52.732822 9093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:48:52.733875 9093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:48:52.743539 9103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:48:52.743585 9093 server_base.cc:1034] running on GCE node
W20260811 11:48:52.743526 9100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:48:52.743528 9101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:48:52.744374 9093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:48:52.745617 9093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:48:52.746819 9093 hybrid_clock.cc:648] HybridClock initialized: now 1786448932746789 us; error 48 us; skew 500 ppm
Aug 11 11:48:52 dist-test-slave-vkjp krb5kdc[7783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448932, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:48:52.755560 9093 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:48:52.756585 9093 webserver.cc:460] Webserver started at http://127.20.244.126:45067/ using document root <none> and password file <none>
I20260811 11:48:52.757153 9093 fs_manager.cc:359] Metadata directory not provided
I20260811 11:48:52.757216 9093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:48:52.761420 9093 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 11:48:52.763970 9112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:52.765403 9093 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:48:52.765570 9093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "8852f95e54dc44bbb5e598a2be64eb3e"
format_stamp: "Formatted at 2026-08-11 11:48:10 on dist-test-slave-vkjp"
server_key: "d7fc853a139f8932cde469dd3413f0d0"
server_key_iv: "ab8bc27bcf28d88ffff470f93f877892"
server_key_version: "encryptionkey@0"
I20260811 11:48:52.766172 9093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:48:52.780224 9093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:48:52.783876 9093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:48:52.784119 9093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:48:52.791868 9093 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:39665
I20260811 11:48:52.792227 9173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:39665 every 8 connection(s)
I20260811 11:48:52.793013 9093 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:48:52.797521 9174 sys_catalog.cc:263] Verifying existing consensus state
I20260811 11:48:52.798697 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 9093
I20260811 11:48:52.799216 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:46533
--local_ip_for_outbound_sockets=127.20.244.65
--tserver_master_addrs=127.20.244.126:39665
--webserver_port=36391
--webserver_interface=127.20.244.65
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:43143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:48:52.799417 9174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e: Bootstrap starting.
I20260811 11:48:52.818349 9174 log.cc:824] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e: Log is configured to *not* fsync() on all Append() calls
I20260811 11:48:52.830364 9174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:48:52.830837 9174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e: Bootstrap complete.
I20260811 11:48:52.835186 9174 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39665 } }
I20260811 11:48:52.835664 9174 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8852f95e54dc44bbb5e598a2be64eb3e, State: Initialized, Role: FOLLOWER
I20260811 11:48:52.836268 9174 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39665 } }
I20260811 11:48:52.836431 9174 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:48:52.836524 9174 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:48:52.836647 9174 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 2 FOLLOWER]: Advancing to term 3
I20260811 11:48:52.838678 9174 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39665 } }
I20260811 11:48:52.839044 9174 leader_election.cc:302] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8852f95e54dc44bbb5e598a2be64eb3e; no voters:
I20260811 11:48:52.839473 9174 leader_election.cc:288] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 11:48:52.839591 9178 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 3 FOLLOWER]: Leader election won for term 3
I20260811 11:48:52.839823 9178 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [term 3 LEADER]: Becoming Leader. State: Replica: 8852f95e54dc44bbb5e598a2be64eb3e, State: Running, Role: LEADER
I20260811 11:48:52.840133 9178 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39665 } }
I20260811 11:48:52.840813 9174 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:48:52.841588 9179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39665 } } }
I20260811 11:48:52.841724 9179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [sys.catalog]: This master's current role is: LEADER
I20260811 11:48:52.842052 9181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8852f95e54dc44bbb5e598a2be64eb3e. Latest consensus state: current_term: 3 leader_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8852f95e54dc44bbb5e598a2be64eb3e" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39665 } } }
I20260811 11:48:52.842206 9181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e [sys.catalog]: This master's current role is: LEADER
I20260811 11:48:52.842777 9187 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:48:52.847991 9187 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:48:52.848691 9187 catalog_manager.cc:1259] Loaded cluster ID: ca16085ff7cf4d9a91a1d53d18c57aee
I20260811 11:48:52.848776 9187 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:48:52.851409 9187 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:48:52.852170 9187 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e: Loaded TSK: 0
I20260811 11:48:52.852258 9187 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8852f95e54dc44bbb5e598a2be64eb3e: Loaded TSK: 1
F20260811 11:48:52.853777 9187 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7ff53c8479ad google::LogMessage::Fail() at ??:0
@ 0x7ff53c84a88a google::LogMessage::SendToLog() at ??:0
@ 0x7ff53c8474de google::LogMessage::Flush() at ??:0
@ 0x7ff53c848a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7ff53f50b18d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7ff53f503f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7ff5471ac7bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7ff54718699c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7ff547187178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7ff5471c8df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7ff5471e782b std::function<>::operator()() at ??:0
@ 0x7ff547186b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7ff547187f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7ff547184579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7ff5471c8640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7ff53ea993d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7ff53ea99c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7ff53ea9b3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7ff53ea8a512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7ff5400ce6db start_thread at ??:0
@ 0x7ff53b34561f clone at ??:0
W20260811 11:48:52.957121 9176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:48:52.957540 9176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:48:52.957612 9176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:48:52.963889 9176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:48:52.963987 9176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:48:52.964077 9176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:48:52.972888 9176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:43143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:46533
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=36391
--tserver_master_addrs=127.20.244.126:39665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:48:52.974488 9176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:48:52.975927 9176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:48:52.988324 9234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:48:52.988495 9232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:48:52.988608 9231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:48:52.988873 9176 server_base.cc:1034] running on GCE node
I20260811 11:48:52.989329 9176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:48:52.990105 9176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:48:52.991314 9176 hybrid_clock.cc:648] HybridClock initialized: now 1786448932991282 us; error 46 us; skew 500 ppm
Aug 11 11:48:52 dist-test-slave-vkjp krb5kdc[7783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448932, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:48:52.994645 9176 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:48:52.995787 9176 webserver.cc:460] Webserver started at http://127.20.244.65:36391/ using document root <none> and password file <none>
I20260811 11:48:52.996387 9176 fs_manager.cc:359] Metadata directory not provided
I20260811 11:48:52.996483 9176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:48:53.001102 9176 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 11:48:53.003897 9243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:53.005658 9176 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:48:53.005832 9176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "546aa53b59de4776a6c70558f49b4d2e"
format_stamp: "Formatted at 2026-08-11 11:48:10 on dist-test-slave-vkjp"
server_key: "c8616358b54fc32463f5a2c6346ffe73"
server_key_iv: "de8563c4d20837e7651e1a3d22e100c4"
server_key_version: "encryptionkey@0"
I20260811 11:48:53.006557 9176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:48:53.034759 9176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:48:53.038720 9176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:48:53.038985 9176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:48:53.039724 9176 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:48:53.041159 9250 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 11:48:53.047009 9176 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 11:48:53.047168 9176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260811 11:48:53.047297 9176 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 11:48:53.049243 9176 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 11:48:53.049345 9176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260811 11:48:53.049633 9250 tablet_bootstrap.cc:492] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e: Bootstrap starting.
I20260811 11:48:53.061810 9176 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:46533
I20260811 11:48:53.062122 9375 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:46533 every 8 connection(s)
I20260811 11:48:53.063030 9176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:48:53.068442 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 9176
I20260811 11:48:53.068974 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:40787
--local_ip_for_outbound_sockets=127.20.244.66
--tserver_master_addrs=127.20.244.126:39665
--webserver_port=42035
--webserver_interface=127.20.244.66
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:43143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:48:53.072691 9250 log.cc:824] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e: Log is configured to *not* fsync() on all Append() calls
I20260811 11:48:53.084470 9250 tablet_bootstrap.cc:492] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:48:53.084961 9250 tablet_bootstrap.cc:492] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e: Bootstrap complete.
I20260811 11:48:53.086472 9250 ts_tablet_manager.cc:1397] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e: Time spent bootstrapping tablet: real 0.037s user 0.033s sys 0.000s
I20260811 11:48:53.090090 9250 raft_consensus.cc:348] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:53.090829 9250 raft_consensus.cc:729] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aa53b59de4776a6c70558f49b4d2e, State: Initialized, Role: FOLLOWER
I20260811 11:48:53.091480 9250 consensus_queue.cc:260] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:53.092777 9250 ts_tablet_manager.cc:1428] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e: Time spent starting tablet: real 0.006s user 0.009s sys 0.000s
W20260811 11:48:53.117939 9378 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:48:53.065280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.65:60839)
0811 11:48:53.065892 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:53.065953 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 11:48:53.066862 (+ 909us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:48:53.117144 (+ 50282us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":176,"threads_started":1}
W20260811 11:48:53.118599 9376 heartbeater.cc:644] Failed to heartbeat to 127.20.244.126:39665 (0 consecutive failures): Network error: Failed to ping master at 127.20.244.126:39665: Client connection negotiation failed: client connection to 127.20.244.126:39665: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 11:48:53.119479 9378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:53.119191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.65:43147)
0811 11:48:53.119322 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:53.119404 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 11:48:53.120319 9378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:53.120062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.65:43549)
0811 11:48:53.120200 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:53.120259 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 11:48:53.120548 9376 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 11:48:53.204608 9379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:48:53.204900 9379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:48:53.204985 9379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:48:53.209522 9379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:48:53.209615 9379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:48:53.209681 9379 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:48:53.215735 9379 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:43143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:40787
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=42035
--tserver_master_addrs=127.20.244.126:39665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9379
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:48:53.217001 9379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:48:53.218182 9379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:48:53.228742 9390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:48:53.228735 9386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:48:53.228772 9387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:48:53.228871 9379 server_base.cc:1034] running on GCE node
I20260811 11:48:53.229496 9379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:48:53.230362 9379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:48:53.231714 9379 hybrid_clock.cc:648] HybridClock initialized: now 1786448933231679 us; error 54 us; skew 500 ppm
Aug 11 11:48:53 dist-test-slave-vkjp krb5kdc[7783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448933, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:48:53.234908 9379 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:48:53.235934 9379 webserver.cc:460] Webserver started at http://127.20.244.66:42035/ using document root <none> and password file <none>
I20260811 11:48:53.236676 9379 fs_manager.cc:359] Metadata directory not provided
I20260811 11:48:53.236748 9379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:48:53.241039 9379 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260811 11:48:53.243435 9398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:53.244915 9379 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260811 11:48:53.245078 9379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "72737f54fafa4addac27a299bc526914"
format_stamp: "Formatted at 2026-08-11 11:48:10 on dist-test-slave-vkjp"
server_key: "09bde2628fc600fe0277899e8b06f265"
server_key_iv: "e55439db85f1520e93fe0de24557dfc9"
server_key_version: "encryptionkey@0"
I20260811 11:48:53.245685 9379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:48:53.263990 9379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:48:53.267747 9379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:48:53.268004 9379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:48:53.268711 9379 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:48:53.269613 9379 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:48:53.269660 9379 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:53.269724 9379 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:48:53.269757 9379 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:53.280325 9379 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:40787
I20260811 11:48:53.280345 9528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:40787 every 8 connection(s)
I20260811 11:48:53.281476 9379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:48:53.285562 9533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:53.283799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.66:35583)
0811 11:48:53.284278 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:53.284390 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":129,"threads_started":1}
W20260811 11:48:53.286015 9531 heartbeater.cc:644] Failed to heartbeat to 127.20.244.126:39665 (0 consecutive failures): Network error: Failed to ping master at 127.20.244.126:39665: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
I20260811 11:48:53.286684 9533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:53.286452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.66:45705)
0811 11:48:53.286573 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:53.286629 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 11:48:53.287376 9533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:53.287167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.66:41237)
0811 11:48:53.287271 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:53.287319 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 11:48:53.287577 9531 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 11:48:53.289229 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 9379
I20260811 11:48:53.289680 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:33909
--local_ip_for_outbound_sockets=127.20.244.67
--tserver_master_addrs=127.20.244.126:39665
--webserver_port=42905
--webserver_interface=127.20.244.67
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:43143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:48:53.411441 9534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:48:53.411806 9534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:48:53.411906 9534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:48:53.416343 9534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:48:53.416431 9534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:48:53.416495 9534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:48:53.422281 9534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:43143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:33909
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=42905
--tserver_master_addrs=127.20.244.126:39665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:48:53.423640 9534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:48:53.424784 9534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:48:53.435187 9540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:48:53.435209 9539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:48:53.435318 9534 server_base.cc:1034] running on GCE node
W20260811 11:48:53.435184 9542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:48:53.436048 9534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:48:53.437146 9534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:48:53.438364 9534 hybrid_clock.cc:648] HybridClock initialized: now 1786448933438341 us; error 33 us; skew 500 ppm
Aug 11 11:48:53 dist-test-slave-vkjp krb5kdc[7783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448933, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:48:53.441347 9534 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:48:53.442317 9534 webserver.cc:460] Webserver started at http://127.20.244.67:42905/ using document root <none> and password file <none>
I20260811 11:48:53.442894 9534 fs_manager.cc:359] Metadata directory not provided
I20260811 11:48:53.442957 9534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:48:53.447335 9534 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:48:53.449620 9549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:53.451332 9534 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:48:53.451650 9534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "c6158cdf54e44739a475735c0e2a1fa0"
format_stamp: "Formatted at 2026-08-11 11:48:11 on dist-test-slave-vkjp"
server_key: "e38db30d1b2c0a32e6bb46e29ecd12cd"
server_key_iv: "c0a3a194b8fc6ddb7f33977f7ea1cdaa"
server_key_version: "encryptionkey@0"
I20260811 11:48:53.452265 9534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:48:53.465394 9534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:48:53.469573 9534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:48:53.469835 9534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:48:53.470566 9534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:48:53.471558 9534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:48:53.471609 9534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:53.471652 9534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:48:53.471704 9534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:48:53.481899 9534 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:33909
I20260811 11:48:53.481899 9675 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:33909 every 8 connection(s)
I20260811 11:48:53.483039 9534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:48:53.487811 9679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:53.485645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.67:37695)
0811 11:48:53.486226 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:53.486353 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":153,"threads_started":1}
I20260811 11:48:53.488413 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 9534
W20260811 11:48:53.488535 9676 heartbeater.cc:644] Failed to heartbeat to 127.20.244.126:39665 (0 consecutive failures): Network error: Failed to ping master at 127.20.244.126:39665: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
I20260811 11:48:53.489303 9679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:53.489049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.67:36307)
0811 11:48:53.489183 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:53.489239 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 11:48:53.490022 9679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:53.489788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.67:60957)
0811 11:48:53.489917 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:53.489970 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 11:48:53.490209 9676 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 11:48:54.121902 9681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:54.121354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.65:33819)
0811 11:48:54.121714 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:54.121783 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":98,"threads_started":1}
I20260811 11:48:54.288626 9682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:54.288143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.66:49487)
0811 11:48:54.288440 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:54.288508 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":76,"threads_started":1}
I20260811 11:48:54.491530 9683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:54.490980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.67:36253)
0811 11:48:54.491297 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:54.491382 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":100,"threads_started":1}
I20260811 11:48:54.596568 9684 raft_consensus.cc:482] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:48:54.596766 9684 raft_consensus.cc:504] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:54.598014 9684 leader_election.cc:288] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6158cdf54e44739a475735c0e2a1fa0 (127.20.244.67:33909), 72737f54fafa4addac27a299bc526914 (127.20.244.66:40787)
Aug 11 11:48:54 dist-test-slave-vkjp krb5kdc[7783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448932, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.66@KRBTEST.COM
Aug 11 11:48:54 dist-test-slave-vkjp krb5kdc[7783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448932, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.67@KRBTEST.COM
I20260811 11:48:54.613649 9689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:54.598554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:44707 (local address 127.20.244.67:33909)
0811 11:48:54.599024 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:54.599044 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:54.599116 (+ 72us) server_negotiation.cc:407] Connection header received
0811 11:48:54.599816 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:54.599822 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:54.600111 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:54.600428 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:48:54.601718 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:54.602681 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:54.604004 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:54.604480 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:54.604663 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:54.608202 (+ 3539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:48:54.608211 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:48:54.608229 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:48:54.608277 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:48:54.610259 (+ 1982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:54.610898 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:54.610905 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:54.610911 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:54.611073 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:54.611516 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:54.611519 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:54.611520 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:54.612162 (+ 642us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:48:54.612368 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:54.613131 (+ 763us) server_negotiation.cc:299] Negotiation successful
0811 11:48:54.613445 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":173,"threads_started":1}
I20260811 11:48:54.613646 9686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:54.598529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:54539 (local address 127.20.244.66:40787)
0811 11:48:54.598920 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0811 11:48:54.598952 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0811 11:48:54.598993 (+ 41us) server_negotiation.cc:407] Connection header received
0811 11:48:54.599748 (+ 755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:48:54.599754 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:48:54.600107 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:48:54.600353 (+ 246us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:48:54.601733 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:54.602682 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:54.604002 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:48:54.604485 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:48:54.604664 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:54.607841 (+ 3177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:48:54.607847 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:48:54.607859 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:48:54.607894 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:48:54.610056 (+ 2162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:54.610898 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:54.610905 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:54.610911 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:54.611073 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:48:54.611739 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:48:54.611742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:48:54.611744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:48:54.612219 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:48:54.612343 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 11:48:54.613131 (+ 788us) server_negotiation.cc:299] Negotiation successful
0811 11:48:54.613445 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":130,"threads_started":1}
I20260811 11:48:54.613641 9681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:54.598243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:33909 (local address 127.20.244.65:44707)
0811 11:48:54.598374 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:54.598391 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:48:54.598503 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:48:54.600493 (+ 1990us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:48:54.600499 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:48:54.601050 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:48:54.601537 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:54.601551 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:54.602860 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:54.602863 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:54.603866 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:54.603876 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:54.604614 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:54.604618 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:54.604851 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:54.605915 (+ 1064us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:48:54.605928 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:48:54.607994 (+ 2066us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:48:54.610383 (+ 2389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:48:54.610386 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:48:54.610387 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:48:54.610743 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:48:54.611214 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:48:54.611218 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:48:54.611220 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:48:54.611415 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:48:54.612339 (+ 924us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:48:54.612341 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:48:54.612755 (+ 414us) client_negotiation.cc:769] Sending connection context
0811 11:48:54.612988 (+ 233us) client_negotiation.cc:240] Negotiation successful
0811 11:48:54.613462 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":317,"spinlock_wait_cycles":338048}
I20260811 11:48:54.613639 9685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:54.598256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:40787 (local address 127.20.244.65:54539)
0811 11:48:54.598705 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:54.598721 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:48:54.598856 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:48:54.600731 (+ 1875us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:48:54.600733 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:48:54.601048 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:48:54.601537 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:54.601551 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:54.602871 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:54.602874 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:54.603864 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:48:54.603875 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:48:54.604619 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:48:54.604623 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:48:54.604850 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:48:54.605885 (+ 1035us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:48:54.605920 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:48:54.607596 (+ 1676us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:48:54.610192 (+ 2596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:48:54.610202 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:48:54.610218 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:48:54.610716 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:48:54.611516 (+ 800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:48:54.611518 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:48:54.611519 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:48:54.611624 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:48:54.612329 (+ 705us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:48:54.612337 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:48:54.612755 (+ 418us) client_negotiation.cc:769] Sending connection context
0811 11:48:54.612988 (+ 233us) client_negotiation.cc:240] Negotiation successful
0811 11:48:54.613405 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"mutex_wait_us":359,"spinlock_wait_cycles":19840,"thread_start_us":90,"threads_started":1}
W20260811 11:48:54.616936 9246 leader_election.cc:341] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 72737f54fafa4addac27a299bc526914 (127.20.244.66:40787): Not found: Tablet not found: e4cf85f67bdd46c4896a4c813393b57a
W20260811 11:48:54.617159 9244 leader_election.cc:341] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c6158cdf54e44739a475735c0e2a1fa0 (127.20.244.67:33909): Not found: Tablet not found: e4cf85f67bdd46c4896a4c813393b57a
I20260811 11:48:54.617304 9244 leader_election.cc:302] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aa53b59de4776a6c70558f49b4d2e; no voters: 72737f54fafa4addac27a299bc526914, c6158cdf54e44739a475735c0e2a1fa0
I20260811 11:48:54.617652 9684 raft_consensus.cc:2726] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 11:48:55.123262 9690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:55.122771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.65:57983)
0811 11:48:55.123041 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:55.123160 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":82,"threads_started":1}
I20260811 11:48:55.289786 9691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:55.289386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.66:58155)
0811 11:48:55.289635 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:55.289694 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":77,"threads_started":1}
I20260811 11:48:55.492805 9692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:55.492340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.67:55525)
0811 11:48:55.492639 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:55.492701 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":96,"threads_started":1}
I20260811 11:48:56.124521 9693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:56.124097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.65:41747)
0811 11:48:56.124356 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:56.124415 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":80,"threads_started":1}
I20260811 11:48:56.291010 9694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:56.290580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.66:32859)
0811 11:48:56.290855 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:56.290915 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":79,"threads_started":1}
I20260811 11:48:56.494448 9695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:56.493900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.67:50165)
0811 11:48:56.494231 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:56.494303 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":95,"threads_started":1}
I20260811 11:48:56.859771 9696 raft_consensus.cc:482] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:48:56.859908 9696 raft_consensus.cc:504] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:56.860329 9696 leader_election.cc:288] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6158cdf54e44739a475735c0e2a1fa0 (127.20.244.67:33909), 72737f54fafa4addac27a299bc526914 (127.20.244.66:40787)
W20260811 11:48:56.861306 9244 leader_election.cc:341] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c6158cdf54e44739a475735c0e2a1fa0 (127.20.244.67:33909): Not found: Tablet not found: e4cf85f67bdd46c4896a4c813393b57a
W20260811 11:48:56.861449 9246 leader_election.cc:341] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 72737f54fafa4addac27a299bc526914 (127.20.244.66:40787): Not found: Tablet not found: e4cf85f67bdd46c4896a4c813393b57a
I20260811 11:48:56.861630 9246 leader_election.cc:302] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aa53b59de4776a6c70558f49b4d2e; no voters: 72737f54fafa4addac27a299bc526914, c6158cdf54e44739a475735c0e2a1fa0
I20260811 11:48:56.861832 9696 raft_consensus.cc:2726] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 11:48:57.125896 9697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:57.125376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.65:41003)
0811 11:48:57.125724 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:57.125793 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":105,"threads_started":1}
I20260811 11:48:57.292346 9698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:57.291894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.66:36609)
0811 11:48:57.292181 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:57.292247 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":86,"threads_started":1}
I20260811 11:48:57.495788 9699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:57.495355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.67:52901)
0811 11:48:57.495632 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:57.495692 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":87,"threads_started":1}
I20260811 11:48:58.127628 9700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:58.126940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.65:58889)
0811 11:48:58.127409 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:58.127481 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":172,"threads_started":1}
I20260811 11:48:58.293831 9701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:58.293302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.66:54551)
0811 11:48:58.293606 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:58.293675 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":83,"threads_started":1}
I20260811 11:48:58.497084 9702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:58.496650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.67:43123)
0811 11:48:58.496927 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:58.496981 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":92,"threads_started":1}
I20260811 11:48:59.129065 9703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:59.128561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.65:38335)
0811 11:48:59.128894 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:59.128960 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":86,"threads_started":1}
I20260811 11:48:59.295339 9704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:59.294797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.66:50197)
0811 11:48:59.295157 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:59.295229 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":79,"threads_started":1}
I20260811 11:48:59.498430 9705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:48:59.497957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.67:52411)
0811 11:48:59.498260 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0811 11:48:59.498327 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":83,"threads_started":1}
I20260811 11:48:59.797811 9706 raft_consensus.cc:482] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:48:59.797937 9706 raft_consensus.cc:504] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:48:59.798447 9706 leader_election.cc:288] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6158cdf54e44739a475735c0e2a1fa0 (127.20.244.67:33909), 72737f54fafa4addac27a299bc526914 (127.20.244.66:40787)
W20260811 11:48:59.799420 9246 leader_election.cc:341] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 72737f54fafa4addac27a299bc526914 (127.20.244.66:40787): Not found: Tablet not found: e4cf85f67bdd46c4896a4c813393b57a
W20260811 11:48:59.799539 9244 leader_election.cc:341] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c6158cdf54e44739a475735c0e2a1fa0 (127.20.244.67:33909): Not found: Tablet not found: e4cf85f67bdd46c4896a4c813393b57a
I20260811 11:48:59.799620 9244 leader_election.cc:302] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aa53b59de4776a6c70558f49b4d2e; no voters: 72737f54fafa4addac27a299bc526914, c6158cdf54e44739a475735c0e2a1fa0
I20260811 11:48:59.799782 9706 raft_consensus.cc:2726] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 11:49:00.130571 9707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:00.130011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.65:37495)
0811 11:49:00.130384 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:00.130461 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":94,"threads_started":1}
I20260811 11:49:00.296821 9708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:00.296231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.66:46231)
0811 11:49:00.296624 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:00.296694 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":94,"threads_started":1}
I20260811 11:49:00.499984 9709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:00.499454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.67:57649)
0811 11:49:00.499810 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:00.499878 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":83,"threads_started":1}
I20260811 11:49:01.131973 9710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:01.131461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.65:39731)
0811 11:49:01.131792 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:01.131861 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":95,"threads_started":1}
I20260811 11:49:01.298501 9711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:01.297853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.66:47079)
0811 11:49:01.298202 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:01.298350 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":116,"threads_started":1}
I20260811 11:49:01.365782 9715 raft_consensus.cc:482] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:49:01.365942 9715 raft_consensus.cc:504] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:49:01.366357 9715 leader_election.cc:288] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6158cdf54e44739a475735c0e2a1fa0 (127.20.244.67:33909), 72737f54fafa4addac27a299bc526914 (127.20.244.66:40787)
W20260811 11:49:01.367218 9246 leader_election.cc:341] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 72737f54fafa4addac27a299bc526914 (127.20.244.66:40787): Not found: Tablet not found: e4cf85f67bdd46c4896a4c813393b57a
W20260811 11:49:01.367367 9244 leader_election.cc:341] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c6158cdf54e44739a475735c0e2a1fa0 (127.20.244.67:33909): Not found: Tablet not found: e4cf85f67bdd46c4896a4c813393b57a
I20260811 11:49:01.367475 9244 leader_election.cc:302] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aa53b59de4776a6c70558f49b4d2e; no voters: 72737f54fafa4addac27a299bc526914, c6158cdf54e44739a475735c0e2a1fa0
I20260811 11:49:01.367654 9715 raft_consensus.cc:2726] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 11:49:01.501451 9716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:01.500911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.67:45827)
0811 11:49:01.501237 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:01.501342 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":122,"threads_started":1}
I20260811 11:49:02.133390 9717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:02.132882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.65:36315)
0811 11:49:02.133175 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:02.133250 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":99,"threads_started":1}
I20260811 11:49:02.299969 9718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:02.299425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.66:57431)
0811 11:49:02.299788 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:02.299861 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":101,"threads_started":1}
I20260811 11:49:02.502923 9719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:02.502368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.67:41299)
0811 11:49:02.502713 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:02.502809 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":102,"threads_started":1}
I20260811 11:49:03.134868 9720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:03.134395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.65:34153)
0811 11:49:03.134677 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:03.134758 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":77,"threads_started":1}
I20260811 11:49:03.301321 9721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:03.300856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.66:44177)
0811 11:49:03.301159 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:03.301221 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":113,"threads_started":1}
I20260811 11:49:03.504412 9722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:03.503924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.67:60121)
0811 11:49:03.504238 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:03.504308 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":100,"threads_started":1}
I20260811 11:49:04.136292 9723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:04.135817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.65:37449)
0811 11:49:04.136121 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:04.136188 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":97,"threads_started":1}
I20260811 11:49:04.302846 9724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:04.302329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.66:54865)
0811 11:49:04.302663 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:04.302731 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":119,"threads_started":1}
I20260811 11:49:04.505854 9725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:04.505339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.67:54917)
0811 11:49:04.505681 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:04.505751 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":110,"threads_started":1}
I20260811 11:49:05.137712 9726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:05.137208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.65:51143)
0811 11:49:05.137545 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:05.137610 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":94,"threads_started":1}
I20260811 11:49:05.304229 9728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:05.303727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.66:34607)
0811 11:49:05.304058 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:05.304123 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":120,"threads_started":1}
I20260811 11:49:05.507326 9729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:05.506796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.67:39713)
0811 11:49:05.507077 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:05.507218 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":84,"threads_started":1}
I20260811 11:49:06.041235 9731 raft_consensus.cc:482] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:49:06.041432 9731 raft_consensus.cc:504] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6158cdf54e44739a475735c0e2a1fa0" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 33909 } } peers { permanent_uuid: "72737f54fafa4addac27a299bc526914" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 40787 } } peers { permanent_uuid: "546aa53b59de4776a6c70558f49b4d2e" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46533 } }
I20260811 11:49:06.041922 9731 leader_election.cc:288] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6158cdf54e44739a475735c0e2a1fa0 (127.20.244.67:33909), 72737f54fafa4addac27a299bc526914 (127.20.244.66:40787)
W20260811 11:49:06.042826 9244 leader_election.cc:341] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c6158cdf54e44739a475735c0e2a1fa0 (127.20.244.67:33909): Not found: Tablet not found: e4cf85f67bdd46c4896a4c813393b57a
W20260811 11:49:06.042932 9246 leader_election.cc:341] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 72737f54fafa4addac27a299bc526914 (127.20.244.66:40787): Not found: Tablet not found: e4cf85f67bdd46c4896a4c813393b57a
I20260811 11:49:06.043000 9246 leader_election.cc:302] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aa53b59de4776a6c70558f49b4d2e; no voters: 72737f54fafa4addac27a299bc526914, c6158cdf54e44739a475735c0e2a1fa0
I20260811 11:49:06.043159 9731 raft_consensus.cc:2726] T e4cf85f67bdd46c4896a4c813393b57a P 546aa53b59de4776a6c70558f49b4d2e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 11:49:06.139243 9733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:06.138599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.65:46673)
0811 11:49:06.138909 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:06.138980 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":100,"threads_started":1}
I20260811 11:49:06.305622 9734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:06.305158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.66:33105)
0811 11:49:06.305456 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:06.305520 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":100,"threads_started":1}
I20260811 11:49:06.508601 9735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:06.508152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.67:55587)
0811 11:49:06.508427 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:06.508503 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":118,"threads_started":1}
I20260811 11:49:07.140547 9736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:07.140086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.65:45479)
0811 11:49:07.140373 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:07.140441 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":84,"threads_started":1}
I20260811 11:49:07.306869 9737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:07.306414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.66:33879)
0811 11:49:07.306705 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:07.306767 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":84,"threads_started":1}
I20260811 11:49:07.509876 9738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:07.509458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.67:55867)
0811 11:49:07.509720 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:07.509778 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":88,"threads_started":1}
I20260811 11:49:08.142199 9740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:08.141697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.65:55051)
0811 11:49:08.142013 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:08.142083 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":97,"threads_started":1}
I20260811 11:49:08.308425 9742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:08.307951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.66:54937)
0811 11:49:08.308215 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:08.308275 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":75,"threads_started":1}
I20260811 11:49:08.492882 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 9176
I20260811 11:49:08.503015 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 9379
I20260811 11:49:08.511354 9743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:08.510869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39665 (local address 127.20.244.67:51665)
0811 11:49:08.511194 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:08.511255 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.126:39665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":80,"threads_started":1}
I20260811 11:49:08.511798 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 9534
2026-08-11T11:49:08Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59726 ms)
[----------] 30 tests from SecurityITest (251785 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:08 dist-test-slave-vkjp krb5kdc[9746](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:08 dist-test-slave-vkjp krb5kdc[9746](info): set up 2 sockets
Aug 11 11:49:08 dist-test-slave-vkjp krb5kdc[9746](info): commencing operation
krb5kdc: starting...
W20260811 11:49:09.692806 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:09 dist-test-slave-vkjp krb5kdc[9746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448949, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:49:09.834751 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:41747
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:40453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:41747
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:09.952533 9760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:09.952890 9760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:09.952981 9760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:09.957165 9760 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:09.957285 9760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:09.957331 9760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:09.957398 9760 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:09.957442 9760 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:09.963393 9760 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:40453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:41747
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:41747
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9760
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:09.964639 9760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:09.965731 9760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:09.974861 9768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:09.974938 9760 server_base.cc:1034] running on GCE node
W20260811 11:49:09.974897 9765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:09.974861 9766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:09.975867 9760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:09.977036 9760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:09.978211 9760 hybrid_clock.cc:648] HybridClock initialized: now 1786448949978181 us; error 44 us; skew 500 ppm
Aug 11 11:49:09 dist-test-slave-vkjp krb5kdc[9746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448949, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:09.986964 9760 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:49:09.988035 9760 webserver.cc:460] Webserver started at http://127.20.244.126:39027/ using document root <none> and password file <none>
I20260811 11:49:09.988718 9760 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:09.988832 9760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:09.989104 9760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:09.991508 9760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "f348b5dc3891414e8c3e99146691e0b2"
format_stamp: "Formatted at 2026-08-11 11:49:09 on dist-test-slave-vkjp"
server_key: "4f75b0b83bd9e5867adbff97aa0d32ff"
server_key_iv: "6feea2199e26adc55bae87a6048cf3f7"
server_key_version: "encryptionkey@0"
I20260811 11:49:09.992166 9760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "f348b5dc3891414e8c3e99146691e0b2"
format_stamp: "Formatted at 2026-08-11 11:49:09 on dist-test-slave-vkjp"
server_key: "4f75b0b83bd9e5867adbff97aa0d32ff"
server_key_iv: "6feea2199e26adc55bae87a6048cf3f7"
server_key_version: "encryptionkey@0"
I20260811 11:49:09.996620 9760 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 11:49:09.999496 9776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:10.001008 9760 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 11:49:10.001173 9760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "f348b5dc3891414e8c3e99146691e0b2"
format_stamp: "Formatted at 2026-08-11 11:49:09 on dist-test-slave-vkjp"
server_key: "4f75b0b83bd9e5867adbff97aa0d32ff"
server_key_iv: "6feea2199e26adc55bae87a6048cf3f7"
server_key_version: "encryptionkey@0"
I20260811 11:49:10.001312 9760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:10.021915 9760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:10.025250 9760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:10.025488 9760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:10.032954 9760 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:41747
I20260811 11:49:10.032961 9835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:41747 every 8 connection(s)
I20260811 11:49:10.034004 9760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:10.036876 9836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:10.042616 9836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2: Bootstrap starting.
I20260811 11:49:10.043429 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 9760
I20260811 11:49:10.043581 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:10.043880 21457 external_mini_cluster.cc:1428] Setting key 655f9a9211f3cfac50f1d5bd802718d5
I20260811 11:49:10.045614 9836 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:10.046362 9836 log.cc:824] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:10.048674 9836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2: No bootstrap required, opened a new log
Aug 11 11:49:10 dist-test-slave-vkjp krb5kdc[9746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448949, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:49:10.053519 9836 raft_consensus.cc:348] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f348b5dc3891414e8c3e99146691e0b2" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 41747 } }
I20260811 11:49:10.053794 9836 raft_consensus.cc:374] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:10.053887 9836 raft_consensus.cc:729] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f348b5dc3891414e8c3e99146691e0b2, State: Initialized, Role: FOLLOWER
I20260811 11:49:10.054481 9836 consensus_queue.cc:260] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f348b5dc3891414e8c3e99146691e0b2" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 41747 } }
I20260811 11:49:10.054657 9836 raft_consensus.cc:388] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:10.054740 9836 raft_consensus.cc:482] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:10.054868 9836 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:10.056322 9836 raft_consensus.cc:504] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f348b5dc3891414e8c3e99146691e0b2" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 41747 } }
I20260811 11:49:10.056788 9836 leader_election.cc:302] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f348b5dc3891414e8c3e99146691e0b2; no voters:
I20260811 11:49:10.057199 9836 leader_election.cc:288] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:10.057286 9842 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:10.057516 9842 raft_consensus.cc:686] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2 [term 1 LEADER]: Becoming Leader. State: Replica: f348b5dc3891414e8c3e99146691e0b2, State: Running, Role: LEADER
I20260811 11:49:10.057909 9842 consensus_queue.cc:237] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f348b5dc3891414e8c3e99146691e0b2" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 41747 } }
I20260811 11:49:10.058686 9836 sys_catalog.cc:564] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:10.060043 9844 sys_catalog.cc:455] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f348b5dc3891414e8c3e99146691e0b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f348b5dc3891414e8c3e99146691e0b2" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 41747 } } }
I20260811 11:49:10.060060 9843 sys_catalog.cc:455] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f348b5dc3891414e8c3e99146691e0b2. Latest consensus state: current_term: 1 leader_uuid: "f348b5dc3891414e8c3e99146691e0b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f348b5dc3891414e8c3e99146691e0b2" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 41747 } } }
I20260811 11:49:10.060279 9844 sys_catalog.cc:458] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:10.060310 9843 sys_catalog.cc:458] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:10.060600 9840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:10.045087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41576 (local address 127.20.244.126:41747)
0811 11:49:10.045558 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:10.045573 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:10.045608 (+ 35us) server_negotiation.cc:407] Connection header received
0811 11:49:10.046285 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:10.046302 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:10.046678 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:10.047075 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:10.047986 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.049022 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.050203 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.050697 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.050838 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:10.054043 (+ 3205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:10.054050 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:10.054068 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:10.054105 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:10.056638 (+ 2533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:10.057256 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:10.057265 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:10.057274 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:10.057534 (+ 260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:10.057940 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:10.057943 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:10.057944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:10.058424 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:10.058655 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:10.059008 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 11:49:10.059416 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":149,"threads_started":1}
I20260811 11:49:10.060822 9855 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:10.064265 9855 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:10.070152 9855 catalog_manager.cc:1347] Generated new cluster ID: 8635f5a19cc041bfa5a38db05ae7c5b2
I20260811 11:49:10.070322 9855 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:10.083689 9855 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:10.085041 9855 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:10.104645 9855 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2: Generated new TSK 0
I20260811 11:49:10.105670 9855 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.244.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
I20260811 11:49:10.139402 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:41747
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:40453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:10.260177 9867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:10.260458 9867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:10.260504 9867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:10.264757 9867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:10.264827 9867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:10.264886 9867 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:49:10.270363 9867 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:40453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:41747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9867
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:10.271570 9867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:10.272588 9867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:10.282796 9873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:10.282794 9876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:10.282796 9874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:10.283128 9867 server_base.cc:1034] running on GCE node
I20260811 11:49:10.283620 9867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:10.284360 9867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:10.285557 9867 hybrid_clock.cc:648] HybridClock initialized: now 1786448950285539 us; error 30 us; skew 500 ppm
Aug 11 11:49:10 dist-test-slave-vkjp krb5kdc[9746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448950, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:10.288516 9867 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:49:10.289499 9867 webserver.cc:460] Webserver started at http://127.20.244.65:44167/ using document root <none> and password file <none>
I20260811 11:49:10.290097 9867 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:10.290192 9867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:10.290438 9867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:10.292582 9867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "588b085262034ff7ba5d3521f72cb4c6"
format_stamp: "Formatted at 2026-08-11 11:49:10 on dist-test-slave-vkjp"
server_key: "4202dbcea63aabe3633b859206607174"
server_key_iv: "fb86df5f9fe156f3814a7739ab6871e1"
server_key_version: "encryptionkey@0"
I20260811 11:49:10.293160 9867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "588b085262034ff7ba5d3521f72cb4c6"
format_stamp: "Formatted at 2026-08-11 11:49:10 on dist-test-slave-vkjp"
server_key: "4202dbcea63aabe3633b859206607174"
server_key_iv: "fb86df5f9fe156f3814a7739ab6871e1"
server_key_version: "encryptionkey@0"
I20260811 11:49:10.297089 9867 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 11:49:10.299661 9885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:10.300923 9867 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:49:10.301072 9867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "588b085262034ff7ba5d3521f72cb4c6"
format_stamp: "Formatted at 2026-08-11 11:49:10 on dist-test-slave-vkjp"
server_key: "4202dbcea63aabe3633b859206607174"
server_key_iv: "fb86df5f9fe156f3814a7739ab6871e1"
server_key_version: "encryptionkey@0"
I20260811 11:49:10.301189 9867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:10.314692 9867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:10.317766 9867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:10.317991 9867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:10.318629 9867 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:49:10.319581 9867 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:49:10.319653 9867 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:10.319720 9867 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:49:10.319769 9867 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:10.328884 9867 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:43467
I20260811 11:49:10.328912 10015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:43467 every 8 connection(s)
I20260811 11:49:10.329775 9867 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:49:10.337915 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 9867
I20260811 11:49:10.338080 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:49:10.338479 21457 external_mini_cluster.cc:1428] Setting key 6828f1e48c1081c94911afb82c4a5b5e
Aug 11 11:49:10 dist-test-slave-vkjp krb5kdc[9746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448950, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:49:10.344843 9840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:10.331705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:47991 (local address 127.20.244.126:41747)
0811 11:49:10.331860 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:10.331865 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:10.332758 (+ 893us) server_negotiation.cc:407] Connection header received
0811 11:49:10.334039 (+ 1281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:10.334041 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:10.334088 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:10.334164 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:10.335378 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.335913 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.337050 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.337316 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.337401 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:10.340704 (+ 3303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:10.340708 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:10.340710 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:10.340734 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:10.342497 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:10.343000 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:10.343005 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:10.343009 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:10.343159 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:10.343525 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:10.343531 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:10.343534 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:10.343792 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:10.343915 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:10.344526 (+ 611us) server_negotiation.cc:299] Negotiation successful
0811 11:49:10.344666 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 11:49:10.345743 10020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:10.332148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:41747 (local address 127.20.244.65:47991)
0811 11:49:10.332602 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:10.332646 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:10.333825 (+ 1179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:10.334328 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:10.334334 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:10.334673 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:10.335240 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:10.335257 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.336044 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.336047 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:10.336918 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:10.336928 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.337454 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.337456 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:10.337666 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:10.338544 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:10.338567 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:10.340515 (+ 1948us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:10.342626 (+ 2111us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:10.342632 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:10.342645 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:10.342898 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:10.343267 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:10.343269 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:10.343271 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:10.343423 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:10.343947 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:10.343954 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:10.344247 (+ 293us) client_negotiation.cc:769] Sending connection context
0811 11:49:10.344455 (+ 208us) client_negotiation.cc:240] Negotiation successful
0811 11:49:10.344808 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":113,"threads_started":1}
I20260811 11:49:10.347249 10016 heartbeater.cc:347] Connected to a master server at 127.20.244.126:41747
I20260811 11:49:10.347501 10016 heartbeater.cc:464] Registering TS with master...
I20260811 11:49:10.348039 10016 heartbeater.cc:511] Master 127.20.244.126:41747 requested a full tablet report, sending...
I20260811 11:49:10.349947 9796 ts_manager.cc:194] Registered new tserver with Master: 588b085262034ff7ba5d3521f72cb4c6 (127.20.244.65:43467)
WARNING: no policy specified for kudu/127.20.244.66@KRBTEST.COM; defaulting to no policy
I20260811 11:49:10.351382 9796 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:47991
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
I20260811 11:49:10.370977 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:41747
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:40453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:10.487377 10023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:10.487696 10023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:10.487776 10023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:10.491861 10023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:10.491966 10023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:10.492061 10023 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:49:10.497844 10023 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:40453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:41747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10023
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:10.499042 10023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:10.500154 10023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:10.510563 10028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:10.510591 10030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:10.510566 10033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:10.511159 10023 server_base.cc:1034] running on GCE node
I20260811 11:49:10.511616 10023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:10.512291 10023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:10.513500 10023 hybrid_clock.cc:648] HybridClock initialized: now 1786448950513440 us; error 54 us; skew 500 ppm
Aug 11 11:49:10 dist-test-slave-vkjp krb5kdc[9746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448950, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:10.516398 10023 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:49:10.517367 10023 webserver.cc:460] Webserver started at http://127.20.244.66:32845/ using document root <none> and password file <none>
I20260811 11:49:10.517956 10023 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:10.518054 10023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:10.518304 10023 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:10.520449 10023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "ad07640f942d42f1b3594a606bf2a30b"
format_stamp: "Formatted at 2026-08-11 11:49:10 on dist-test-slave-vkjp"
server_key: "a4db0f0ffb72ad7473b1f7e154dbdf00"
server_key_iv: "a5f9b7be41ba2de8bcdc655297443a03"
server_key_version: "encryptionkey@0"
I20260811 11:49:10.521067 10023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "ad07640f942d42f1b3594a606bf2a30b"
format_stamp: "Formatted at 2026-08-11 11:49:10 on dist-test-slave-vkjp"
server_key: "a4db0f0ffb72ad7473b1f7e154dbdf00"
server_key_iv: "a5f9b7be41ba2de8bcdc655297443a03"
server_key_version: "encryptionkey@0"
I20260811 11:49:10.524946 10023 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 11:49:10.527520 10042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:10.528956 10023 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 11:49:10.529059 10023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "ad07640f942d42f1b3594a606bf2a30b"
format_stamp: "Formatted at 2026-08-11 11:49:10 on dist-test-slave-vkjp"
server_key: "a4db0f0ffb72ad7473b1f7e154dbdf00"
server_key_iv: "a5f9b7be41ba2de8bcdc655297443a03"
server_key_version: "encryptionkey@0"
I20260811 11:49:10.529156 10023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:10.549192 10023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:10.552883 10023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:10.553066 10023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:10.553660 10023 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:49:10.554538 10023 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:49:10.554590 10023 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:10.554634 10023 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:49:10.554659 10023 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:10.564568 10023 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:35499
I20260811 11:49:10.564632 10171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:35499 every 8 connection(s)
I20260811 11:49:10.565522 10023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:49:10.569207 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 10023
I20260811 11:49:10.569352 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:49:10.569674 21457 external_mini_cluster.cc:1428] Setting key 8ef12525d158875e599bddcb7ef1f52a
Aug 11 11:49:10 dist-test-slave-vkjp krb5kdc[9746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448950, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.244.67@KRBTEST.COM; defaulting to no policy
I20260811 11:49:10.580900 9840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:10.567472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:34655 (local address 127.20.244.126:41747)
0811 11:49:10.567643 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:10.567649 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:10.568513 (+ 864us) server_negotiation.cc:407] Connection header received
0811 11:49:10.570249 (+ 1736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:10.570254 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:10.570325 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:10.570395 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:10.572017 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.572604 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.574153 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.574381 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.574505 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:10.577128 (+ 2623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:10.577134 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:10.577141 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:10.577168 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:10.578655 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:10.579259 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:10.579265 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:10.579271 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:10.579353 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:10.579732 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:10.579737 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:10.579739 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:10.579933 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:10.580052 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:10.580587 (+ 535us) server_negotiation.cc:299] Negotiation successful
0811 11:49:10.580721 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 11:49:10.581913 10175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:10.567876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:41747 (local address 127.20.244.66:34655)
0811 11:49:10.568347 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:10.568391 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:10.570000 (+ 1609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:10.570630 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:10.570637 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:10.571113 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:10.571804 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:10.571829 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.572746 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.572752 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:10.574010 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:10.574020 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.574552 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.574556 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:10.574736 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:10.575436 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:10.575453 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:10.576940 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:10.578785 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:10.578792 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:10.578809 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:10.579147 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:10.579458 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:10.579461 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:10.579463 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:10.579625 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:10.580046 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:10.580053 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:10.580323 (+ 270us) client_negotiation.cc:769] Sending connection context
0811 11:49:10.580524 (+ 201us) client_negotiation.cc:240] Negotiation successful
0811 11:49:10.580924 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":124,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.67@KRBTEST.COM" created.
I20260811 11:49:10.583328 10172 heartbeater.cc:347] Connected to a master server at 127.20.244.126:41747
I20260811 11:49:10.583619 10172 heartbeater.cc:464] Registering TS with master...
I20260811 11:49:10.584268 10172 heartbeater.cc:511] Master 127.20.244.126:41747 requested a full tablet report, sending...
I20260811 11:49:10.585536 9796 ts_manager.cc:194] Registered new tserver with Master: ad07640f942d42f1b3594a606bf2a30b (127.20.244.66:35499)
I20260811 11:49:10.586153 9796 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:34655
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
I20260811 11:49:10.602164 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:41747
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:40453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:10.723366 10180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:10.723686 10180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:10.723763 10180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:10.727792 10180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:10.727900 10180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:10.728000 10180 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:49:10.733635 10180 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:40453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:41747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10180
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:10.734925 10180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:10.736022 10180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:10.746536 10186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:10.746577 10187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:10.746557 10180 server_base.cc:1034] running on GCE node
W20260811 11:49:10.746541 10189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:10.747364 10180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:10.748111 10180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:10.749316 10180 hybrid_clock.cc:648] HybridClock initialized: now 1786448950749282 us; error 46 us; skew 500 ppm
Aug 11 11:49:10 dist-test-slave-vkjp krb5kdc[9746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448950, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:10.752453 10180 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:49:10.753436 10180 webserver.cc:460] Webserver started at http://127.20.244.67:34547/ using document root <none> and password file <none>
I20260811 11:49:10.754057 10180 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:10.754158 10180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:10.754412 10180 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:10.756629 10180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "977178a42ba3401290cfcf409f2fa344"
format_stamp: "Formatted at 2026-08-11 11:49:10 on dist-test-slave-vkjp"
server_key: "f4d96f8438a5f7cffd9b43b23e563dc6"
server_key_iv: "4499b87c5a631a286a024663e035f3aa"
server_key_version: "encryptionkey@0"
I20260811 11:49:10.757249 10180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "977178a42ba3401290cfcf409f2fa344"
format_stamp: "Formatted at 2026-08-11 11:49:10 on dist-test-slave-vkjp"
server_key: "f4d96f8438a5f7cffd9b43b23e563dc6"
server_key_iv: "4499b87c5a631a286a024663e035f3aa"
server_key_version: "encryptionkey@0"
I20260811 11:49:10.761701 10180 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 11:49:10.764529 10200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:10.765998 10180 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 11:49:10.766175 10180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "977178a42ba3401290cfcf409f2fa344"
format_stamp: "Formatted at 2026-08-11 11:49:10 on dist-test-slave-vkjp"
server_key: "f4d96f8438a5f7cffd9b43b23e563dc6"
server_key_iv: "4499b87c5a631a286a024663e035f3aa"
server_key_version: "encryptionkey@0"
I20260811 11:49:10.766311 10180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:10.783605 10180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:10.787729 10180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:10.787990 10180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:10.788713 10180 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:49:10.789809 10180 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:49:10.789896 10180 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:10.789980 10180 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:49:10.790040 10180 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:10.800364 10180 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:42521
I20260811 11:49:10.800424 10329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:42521 every 8 connection(s)
I20260811 11:49:10.801425 10180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:49:10.811317 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 10180
I20260811 11:49:10.811492 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:49:10.811793 21457 external_mini_cluster.cc:1428] Setting key def345ae128fdde5d7b16998147c17ec
Aug 11 11:49:10 dist-test-slave-vkjp krb5kdc[9746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448950, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:49:10.816910 9840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:10.803396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:48433 (local address 127.20.244.126:41747)
0811 11:49:10.803552 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:10.803556 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:10.804580 (+ 1024us) server_negotiation.cc:407] Connection header received
0811 11:49:10.806249 (+ 1669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:10.806253 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:10.806330 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:10.806455 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:10.807799 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.808444 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.809762 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.810021 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.810153 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:10.813118 (+ 2965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:10.813122 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:10.813124 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:10.813150 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:10.814643 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:10.815220 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:10.815228 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:10.815230 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:10.815312 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:10.815694 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:10.815698 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:10.815699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:10.815904 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:10.816017 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:10.816590 (+ 573us) server_negotiation.cc:299] Negotiation successful
0811 11:49:10.816722 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 11:49:10.817757 10332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:10.803796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:41747 (local address 127.20.244.67:48433)
0811 11:49:10.804386 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:10.804468 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:10.806007 (+ 1539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:10.806647 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:10.806655 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:10.807051 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:10.807638 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:10.807654 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.808587 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.808596 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:10.809616 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:10.809626 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.810200 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.810204 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:10.810408 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:10.811137 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:10.811167 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:10.812928 (+ 1761us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:10.814775 (+ 1847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:10.814781 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:10.814797 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:10.815073 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:10.815419 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:10.815422 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:10.815424 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:10.815577 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:10.816018 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:10.816027 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:10.816312 (+ 285us) client_negotiation.cc:769] Sending connection context
0811 11:49:10.816528 (+ 216us) client_negotiation.cc:240] Negotiation successful
0811 11:49:10.816877 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":126,"threads_started":1}
I20260811 11:49:10.819276 10330 heartbeater.cc:347] Connected to a master server at 127.20.244.126:41747
I20260811 11:49:10.819561 10330 heartbeater.cc:464] Registering TS with master...
I20260811 11:49:10.820104 10330 heartbeater.cc:511] Master 127.20.244.126:41747 requested a full tablet report, sending...
I20260811 11:49:10.821332 9796 ts_manager.cc:194] Registered new tserver with Master: 977178a42ba3401290cfcf409f2fa344 (127.20.244.67:42521)
I20260811 11:49:10.822063 9796 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:48433
I20260811 11:49:10.826740 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:49:10.837180 9840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:10.829146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39984 (local address 127.20.244.126:41747)
0811 11:49:10.829308 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:10.829312 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:10.829495 (+ 183us) server_negotiation.cc:407] Connection header received
0811 11:49:10.829593 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:10.829595 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:10.829644 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:10.829727 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:10.830431 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.831048 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.831946 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.832187 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.832302 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:10.833718 (+ 1416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:10.833722 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:10.833725 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:10.833759 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:10.835350 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:10.835810 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:10.835814 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:10.835816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:10.835907 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:10.836204 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:10.836209 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:10.836210 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:10.836461 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:10.836610 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:10.836867 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 11:49:10.837005 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 11:49:10.840950 9796 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39984:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:49:10.844220 9796 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:49:10.861074 10345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:10.854719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:35499 (local address 127.0.0.1:42436)
0811 11:49:10.855049 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:10.855065 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:10.855187 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:10.856073 (+ 886us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:10.856076 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:10.856099 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:10.856222 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:10.856230 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.857832 (+ 1602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.857839 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:10.859061 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:10.859073 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.860341 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.860345 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:10.860507 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:10.860558 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 11:49:10.860669 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 11:49:10.860859 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"mutex_wait_us":26,"thread_start_us":139,"threads_started":1}
I20260811 11:49:10.861586 10347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:10.855162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:43467 (local address 127.0.0.1:50086)
0811 11:49:10.855410 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:10.855423 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:10.855508 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:10.856606 (+ 1098us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:10.856609 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:10.856631 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:10.856742 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:10.856750 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.858359 (+ 1609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.858363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:10.859725 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:10.859735 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.861119 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.861123 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:10.861230 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:10.861254 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 11:49:10.861356 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 11:49:10.861442 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":3,"thread_start_us":127,"threads_started":1}
I20260811 11:49:10.861670 10349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:10.855680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50086 (local address 127.20.244.65:43467)
0811 11:49:10.856081 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:10.856087 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:10.856112 (+ 25us) server_negotiation.cc:407] Connection header received
0811 11:49:10.856193 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:10.856198 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:10.856444 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:10.856609 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:10.856925 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.858188 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.859858 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.860921 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.861118 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:10.861274 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:10.861396 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 11:49:10.861505 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":147,"threads_started":1}
I20260811 11:49:10.861810 10342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:10.853740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:42521 (local address 127.0.0.1:40646)
0811 11:49:10.854225 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:10.854286 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:10.854415 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:10.855185 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:10.855194 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:10.855230 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:10.855431 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:10.855442 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.857240 (+ 1798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.857244 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:10.858776 (+ 1532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:10.858788 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.860340 (+ 1552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.860345 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:10.861420 (+ 1075us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:10.861451 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 11:49:10.861547 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 11:49:10.861629 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":941,"thread_start_us":168,"threads_started":1}
I20260811 11:49:10.862444 10346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:10.854914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42436 (local address 127.20.244.66:35499)
0811 11:49:10.855427 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:10.855441 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:10.855468 (+ 27us) server_negotiation.cc:407] Connection header received
0811 11:49:10.855546 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:10.855554 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:10.855888 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:10.856100 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:10.856385 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.857665 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.859221 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.860192 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.862032 (+ 1840us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:10.862181 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:10.862229 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 11:49:10.862319 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":98,"threads_started":1}
I20260811 11:49:10.862994 10343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:10.853941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40646 (local address 127.20.244.67:42521)
0811 11:49:10.854509 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:10.854524 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:10.854556 (+ 32us) server_negotiation.cc:407] Connection header received
0811 11:49:10.854652 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:10.854658 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:10.854936 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:10.855636 (+ 700us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:10.855841 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.857042 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.858920 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:10.860136 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:10.860406 (+ 270us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:10.860643 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:10.862690 (+ 2047us) server_negotiation.cc:299] Negotiation successful
0811 11:49:10.862825 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":181,"threads_started":1}
I20260811 11:49:10.865748 10255 tablet_service.cc:1467] Processing CreateTablet for tablet 487d7067e95040dc8c2e4a95eb37bc29 (DEFAULT_TABLE table=test-table [id=a74055464d3442dfa454efd001e8ecc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:49:10.865764 9939 tablet_service.cc:1467] Processing CreateTablet for tablet 487d7067e95040dc8c2e4a95eb37bc29 (DEFAULT_TABLE table=test-table [id=a74055464d3442dfa454efd001e8ecc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:49:10.865760 10098 tablet_service.cc:1467] Processing CreateTablet for tablet 487d7067e95040dc8c2e4a95eb37bc29 (DEFAULT_TABLE table=test-table [id=a74055464d3442dfa454efd001e8ecc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:49:10.866860 10255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 487d7067e95040dc8c2e4a95eb37bc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:10.866935 9939 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 487d7067e95040dc8c2e4a95eb37bc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:10.866935 10098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 487d7067e95040dc8c2e4a95eb37bc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:10.874146 10350 tablet_bootstrap.cc:492] T 487d7067e95040dc8c2e4a95eb37bc29 P 977178a42ba3401290cfcf409f2fa344: Bootstrap starting.
I20260811 11:49:10.875955 10353 tablet_bootstrap.cc:492] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b: Bootstrap starting.
I20260811 11:49:10.877717 10350 tablet_bootstrap.cc:654] T 487d7067e95040dc8c2e4a95eb37bc29 P 977178a42ba3401290cfcf409f2fa344: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:10.878036 10353 tablet_bootstrap.cc:654] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:10.879004 10350 log.cc:824] T 487d7067e95040dc8c2e4a95eb37bc29 P 977178a42ba3401290cfcf409f2fa344: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:10.879323 10353 log.cc:824] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:10.879598 10352 tablet_bootstrap.cc:492] T 487d7067e95040dc8c2e4a95eb37bc29 P 588b085262034ff7ba5d3521f72cb4c6: Bootstrap starting.
I20260811 11:49:10.881502 10353 tablet_bootstrap.cc:492] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b: No bootstrap required, opened a new log
I20260811 11:49:10.881656 10350 tablet_bootstrap.cc:492] T 487d7067e95040dc8c2e4a95eb37bc29 P 977178a42ba3401290cfcf409f2fa344: No bootstrap required, opened a new log
I20260811 11:49:10.881776 10353 ts_tablet_manager.cc:1397] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 11:49:10.881896 10350 ts_tablet_manager.cc:1397] T 487d7067e95040dc8c2e4a95eb37bc29 P 977178a42ba3401290cfcf409f2fa344: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.004s
I20260811 11:49:10.882331 10352 tablet_bootstrap.cc:654] T 487d7067e95040dc8c2e4a95eb37bc29 P 588b085262034ff7ba5d3521f72cb4c6: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:10.883397 10352 log.cc:824] T 487d7067e95040dc8c2e4a95eb37bc29 P 588b085262034ff7ba5d3521f72cb4c6: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:10.885933 10352 tablet_bootstrap.cc:492] T 487d7067e95040dc8c2e4a95eb37bc29 P 588b085262034ff7ba5d3521f72cb4c6: No bootstrap required, opened a new log
I20260811 11:49:10.885789 10353 raft_consensus.cc:348] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "977178a42ba3401290cfcf409f2fa344" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 42521 } } peers { permanent_uuid: "ad07640f942d42f1b3594a606bf2a30b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35499 } } peers { permanent_uuid: "588b085262034ff7ba5d3521f72cb4c6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 43467 } }
I20260811 11:49:10.886072 10353 raft_consensus.cc:374] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:10.886132 10353 raft_consensus.cc:729] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad07640f942d42f1b3594a606bf2a30b, State: Initialized, Role: FOLLOWER
I20260811 11:49:10.886180 10352 ts_tablet_manager.cc:1397] T 487d7067e95040dc8c2e4a95eb37bc29 P 588b085262034ff7ba5d3521f72cb4c6: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260811 11:49:10.886477 10350 raft_consensus.cc:348] T 487d7067e95040dc8c2e4a95eb37bc29 P 977178a42ba3401290cfcf409f2fa344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "977178a42ba3401290cfcf409f2fa344" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 42521 } } peers { permanent_uuid: "ad07640f942d42f1b3594a606bf2a30b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35499 } } peers { permanent_uuid: "588b085262034ff7ba5d3521f72cb4c6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 43467 } }
I20260811 11:49:10.886792 10350 raft_consensus.cc:374] T 487d7067e95040dc8c2e4a95eb37bc29 P 977178a42ba3401290cfcf409f2fa344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:10.886745 10353 consensus_queue.cc:260] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "977178a42ba3401290cfcf409f2fa344" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 42521 } } peers { permanent_uuid: "ad07640f942d42f1b3594a606bf2a30b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35499 } } peers { permanent_uuid: "588b085262034ff7ba5d3521f72cb4c6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 43467 } }
I20260811 11:49:10.886865 10350 raft_consensus.cc:729] T 487d7067e95040dc8c2e4a95eb37bc29 P 977178a42ba3401290cfcf409f2fa344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 977178a42ba3401290cfcf409f2fa344, State: Initialized, Role: FOLLOWER
I20260811 11:49:10.887382 10350 consensus_queue.cc:260] T 487d7067e95040dc8c2e4a95eb37bc29 P 977178a42ba3401290cfcf409f2fa344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "977178a42ba3401290cfcf409f2fa344" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 42521 } } peers { permanent_uuid: "ad07640f942d42f1b3594a606bf2a30b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35499 } } peers { permanent_uuid: "588b085262034ff7ba5d3521f72cb4c6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 43467 } }
I20260811 11:49:10.887984 10353 ts_tablet_manager.cc:1428] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 11:49:10.888257 10330 heartbeater.cc:503] Master 127.20.244.126:41747 was elected leader, sending a full tablet report...
I20260811 11:49:10.888305 10172 heartbeater.cc:503] Master 127.20.244.126:41747 was elected leader, sending a full tablet report...
I20260811 11:49:10.888540 10350 ts_tablet_manager.cc:1428] T 487d7067e95040dc8c2e4a95eb37bc29 P 977178a42ba3401290cfcf409f2fa344: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 11:49:10.891655 10352 raft_consensus.cc:348] T 487d7067e95040dc8c2e4a95eb37bc29 P 588b085262034ff7ba5d3521f72cb4c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "977178a42ba3401290cfcf409f2fa344" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 42521 } } peers { permanent_uuid: "ad07640f942d42f1b3594a606bf2a30b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35499 } } peers { permanent_uuid: "588b085262034ff7ba5d3521f72cb4c6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 43467 } }
I20260811 11:49:10.892050 10352 raft_consensus.cc:374] T 487d7067e95040dc8c2e4a95eb37bc29 P 588b085262034ff7ba5d3521f72cb4c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:10.892120 10352 raft_consensus.cc:729] T 487d7067e95040dc8c2e4a95eb37bc29 P 588b085262034ff7ba5d3521f72cb4c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 588b085262034ff7ba5d3521f72cb4c6, State: Initialized, Role: FOLLOWER
I20260811 11:49:10.892664 10352 consensus_queue.cc:260] T 487d7067e95040dc8c2e4a95eb37bc29 P 588b085262034ff7ba5d3521f72cb4c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "977178a42ba3401290cfcf409f2fa344" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 42521 } } peers { permanent_uuid: "ad07640f942d42f1b3594a606bf2a30b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35499 } } peers { permanent_uuid: "588b085262034ff7ba5d3521f72cb4c6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 43467 } }
I20260811 11:49:10.893544 10016 heartbeater.cc:503] Master 127.20.244.126:41747 was elected leader, sending a full tablet report...
I20260811 11:49:10.893832 10352 ts_tablet_manager.cc:1428] T 487d7067e95040dc8c2e4a95eb37bc29 P 588b085262034ff7ba5d3521f72cb4c6: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20260811 11:49:11.038435 10360 raft_consensus.cc:482] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:49:11.038689 10360 raft_consensus.cc:504] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "977178a42ba3401290cfcf409f2fa344" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 42521 } } peers { permanent_uuid: "ad07640f942d42f1b3594a606bf2a30b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35499 } } peers { permanent_uuid: "588b085262034ff7ba5d3521f72cb4c6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 43467 } }
I20260811 11:49:11.040040 10360 leader_election.cc:288] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 977178a42ba3401290cfcf409f2fa344 (127.20.244.67:42521), 588b085262034ff7ba5d3521f72cb4c6 (127.20.244.65:43467)
I20260811 11:49:11.044970 10349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:11.040830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:42855 (local address 127.20.244.65:43467)
0811 11:49:11.040962 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:11.040967 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:11.041050 (+ 83us) server_negotiation.cc:407] Connection header received
0811 11:49:11.041214 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:11.041221 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:11.041274 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:11.041355 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:11.041648 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:11.042147 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:11.043664 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:11.044285 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:11.044409 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:11.044465 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:11.044729 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 11:49:11.044824 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 11:49:11.045032 10175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:11.040304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:42521 (local address 127.20.244.66:59155)
0811 11:49:11.040480 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:11.040503 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:11.040622 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:11.041079 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:11.041083 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:11.041107 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:11.041248 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:11.041256 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:11.042442 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:11.042445 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:11.043740 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:11.043752 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:11.044591 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:11.044594 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:11.044706 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:11.044727 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 11:49:11.044799 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 11:49:11.044864 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71,"mutex_wait_us":1}
I20260811 11:49:11.045172 10343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:11.040428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:59155 (local address 127.20.244.67:42521)
0811 11:49:11.040567 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:11.040573 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:11.040589 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:49:11.040769 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:11.040772 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:11.040828 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:11.040896 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:11.041391 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:11.042282 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:11.043889 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:11.044492 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:11.044601 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:11.044646 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:11.044949 (+ 303us) server_negotiation.cc:299] Negotiation successful
0811 11:49:11.045034 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 11:49:11.045562 10363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:11.040564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:43467 (local address 127.20.244.66:42855)
0811 11:49:11.040930 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:11.040947 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:11.041096 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:11.041392 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:11.041395 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:11.041410 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:11.041533 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:11.041538 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:11.042271 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:11.042277 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:11.043541 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:11.043551 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:11.044434 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:11.044438 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:11.044547 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:11.044576 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 11:49:11.044706 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 11:49:11.044789 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":63,"thread_start_us":103,"threads_started":1}
I20260811 11:49:11.046209 10277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "487d7067e95040dc8c2e4a95eb37bc29" candidate_uuid: "ad07640f942d42f1b3594a606bf2a30b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "977178a42ba3401290cfcf409f2fa344" is_pre_election: true
I20260811 11:49:11.046224 9961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "487d7067e95040dc8c2e4a95eb37bc29" candidate_uuid: "ad07640f942d42f1b3594a606bf2a30b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "588b085262034ff7ba5d3521f72cb4c6" is_pre_election: true
I20260811 11:49:11.046548 10277 raft_consensus.cc:2454] T 487d7067e95040dc8c2e4a95eb37bc29 P 977178a42ba3401290cfcf409f2fa344 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad07640f942d42f1b3594a606bf2a30b in term 0.
I20260811 11:49:11.046550 9961 raft_consensus.cc:2454] T 487d7067e95040dc8c2e4a95eb37bc29 P 588b085262034ff7ba5d3521f72cb4c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad07640f942d42f1b3594a606bf2a30b in term 0.
I20260811 11:49:11.047117 10043 leader_election.cc:302] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 977178a42ba3401290cfcf409f2fa344, ad07640f942d42f1b3594a606bf2a30b; no voters:
I20260811 11:49:11.047431 10360 raft_consensus.cc:2781] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:49:11.047533 10360 raft_consensus.cc:482] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:49:11.047591 10360 raft_consensus.cc:3037] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:11.048699 10360 raft_consensus.cc:504] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "977178a42ba3401290cfcf409f2fa344" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 42521 } } peers { permanent_uuid: "ad07640f942d42f1b3594a606bf2a30b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35499 } } peers { permanent_uuid: "588b085262034ff7ba5d3521f72cb4c6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 43467 } }
I20260811 11:49:11.049072 10360 leader_election.cc:288] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b [CANDIDATE]: Term 1 election: Requested vote from peers 977178a42ba3401290cfcf409f2fa344 (127.20.244.67:42521), 588b085262034ff7ba5d3521f72cb4c6 (127.20.244.65:43467)
I20260811 11:49:11.049533 9961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "487d7067e95040dc8c2e4a95eb37bc29" candidate_uuid: "ad07640f942d42f1b3594a606bf2a30b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "588b085262034ff7ba5d3521f72cb4c6"
I20260811 11:49:11.049544 10277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "487d7067e95040dc8c2e4a95eb37bc29" candidate_uuid: "ad07640f942d42f1b3594a606bf2a30b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "977178a42ba3401290cfcf409f2fa344"
I20260811 11:49:11.049690 9961 raft_consensus.cc:3037] T 487d7067e95040dc8c2e4a95eb37bc29 P 588b085262034ff7ba5d3521f72cb4c6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:11.049713 10277 raft_consensus.cc:3037] T 487d7067e95040dc8c2e4a95eb37bc29 P 977178a42ba3401290cfcf409f2fa344 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:11.050791 9961 raft_consensus.cc:2454] T 487d7067e95040dc8c2e4a95eb37bc29 P 588b085262034ff7ba5d3521f72cb4c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad07640f942d42f1b3594a606bf2a30b in term 1.
I20260811 11:49:11.050891 10277 raft_consensus.cc:2454] T 487d7067e95040dc8c2e4a95eb37bc29 P 977178a42ba3401290cfcf409f2fa344 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad07640f942d42f1b3594a606bf2a30b in term 1.
I20260811 11:49:11.051191 10043 leader_election.cc:302] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 588b085262034ff7ba5d3521f72cb4c6, ad07640f942d42f1b3594a606bf2a30b; no voters:
I20260811 11:49:11.051400 10360 raft_consensus.cc:2781] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:11.051649 10360 raft_consensus.cc:686] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b [term 1 LEADER]: Becoming Leader. State: Replica: ad07640f942d42f1b3594a606bf2a30b, State: Running, Role: LEADER
I20260811 11:49:11.052030 10360 consensus_queue.cc:237] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "977178a42ba3401290cfcf409f2fa344" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 42521 } } peers { permanent_uuid: "ad07640f942d42f1b3594a606bf2a30b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35499 } } peers { permanent_uuid: "588b085262034ff7ba5d3521f72cb4c6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 43467 } }
W20260811 11:49:11.052497 10331 tablet.cc:2369] T 487d7067e95040dc8c2e4a95eb37bc29 P 977178a42ba3401290cfcf409f2fa344: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:49:11.055892 9795 catalog_manager.cc:5495] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b reported cstate change: term changed from 0 to 1, leader changed from <none> to ad07640f942d42f1b3594a606bf2a30b (127.20.244.66). New cstate: current_term: 1 leader_uuid: "ad07640f942d42f1b3594a606bf2a30b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "977178a42ba3401290cfcf409f2fa344" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 42521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad07640f942d42f1b3594a606bf2a30b" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "588b085262034ff7ba5d3521f72cb4c6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 43467 } health_report { overall_health: UNKNOWN } } }
W20260811 11:49:11.066850 10173 tablet.cc:2369] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:49:11.081283 10017 tablet.cc:2369] T 487d7067e95040dc8c2e4a95eb37bc29 P 588b085262034ff7ba5d3521f72cb4c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:49:11.098335 10346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:11.094494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42446 (local address 127.20.244.66:35499)
0811 11:49:11.094636 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:11.094639 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:11.094652 (+ 13us) server_negotiation.cc:407] Connection header received
0811 11:49:11.094732 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:11.094735 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:11.094793 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:11.094894 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:49:11.095218 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:11.095768 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:11.096776 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:11.096993 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:11.097073 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:11.097448 (+ 375us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:49:11.097896 (+ 448us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:49:11.097990 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:11.098067 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 11:49:11.098123 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 11:49:11.104997 10277 raft_consensus.cc:1261] T 487d7067e95040dc8c2e4a95eb37bc29 P 977178a42ba3401290cfcf409f2fa344 [term 1 FOLLOWER]: Refusing update from remote peer ad07640f942d42f1b3594a606bf2a30b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:49:11.104997 9961 raft_consensus.cc:1261] T 487d7067e95040dc8c2e4a95eb37bc29 P 588b085262034ff7ba5d3521f72cb4c6 [term 1 FOLLOWER]: Refusing update from remote peer ad07640f942d42f1b3594a606bf2a30b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:49:11.105826 10360 consensus_queue.cc:1035] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b [LEADER]: Connected to new peer: Peer: permanent_uuid: "977178a42ba3401290cfcf409f2fa344" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 42521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:49:11.106091 10364 consensus_queue.cc:1035] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b [LEADER]: Connected to new peer: Peer: permanent_uuid: "588b085262034ff7ba5d3521f72cb4c6" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 43467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:49:11.124035 9795 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39984:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:49:11.124217 9795 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39984:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:49:11.126895 9795 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f348b5dc3891414e8c3e99146691e0b2: Sending DeleteTablet for 3 replicas of tablet 487d7067e95040dc8c2e4a95eb37bc29
I20260811 11:49:11.128032 10098 tablet_service.cc:1514] Processing DeleteTablet for tablet 487d7067e95040dc8c2e4a95eb37bc29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:49:11 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:42436
I20260811 11:49:11.128046 10255 tablet_service.cc:1514] Processing DeleteTablet for tablet 487d7067e95040dc8c2e4a95eb37bc29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:49:11 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:40646
I20260811 11:49:11.128211 9939 tablet_service.cc:1514] Processing DeleteTablet for tablet 487d7067e95040dc8c2e4a95eb37bc29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:49:11 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:50086
I20260811 11:49:11.128703 10379 tablet_replica.cc:330] T 487d7067e95040dc8c2e4a95eb37bc29 P 977178a42ba3401290cfcf409f2fa344: stopping tablet replica
I20260811 11:49:11.128880 10380 tablet_replica.cc:330] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b: stopping tablet replica
I20260811 11:49:11.129195 10382 tablet_replica.cc:330] T 487d7067e95040dc8c2e4a95eb37bc29 P 588b085262034ff7ba5d3521f72cb4c6: stopping tablet replica
I20260811 11:49:11.129307 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 9867
I20260811 11:49:11.129228 10380 raft_consensus.cc:2229] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:49:11.129515 10382 raft_consensus.cc:2229] T 487d7067e95040dc8c2e4a95eb37bc29 P 588b085262034ff7ba5d3521f72cb4c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:49:11.130010 10380 raft_consensus.cc:2258] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:49:11.132804 10380 ts_tablet_manager.cc:1905] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:49:11.133682 10379 raft_consensus.cc:2229] T 487d7067e95040dc8c2e4a95eb37bc29 P 977178a42ba3401290cfcf409f2fa344 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:49:11.134047 10379 raft_consensus.cc:2258] T 487d7067e95040dc8c2e4a95eb37bc29 P 977178a42ba3401290cfcf409f2fa344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:49:11.135674 10379 ts_tablet_manager.cc:1905] T 487d7067e95040dc8c2e4a95eb37bc29 P 977178a42ba3401290cfcf409f2fa344: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:49:11.136569 10380 ts_tablet_manager.cc:1918] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:49:11.136814 10380 log.cc:1196] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/487d7067e95040dc8c2e4a95eb37bc29
I20260811 11:49:11.137239 10380 ts_tablet_manager.cc:1939] T 487d7067e95040dc8c2e4a95eb37bc29 P ad07640f942d42f1b3594a606bf2a30b: Deleting consensus metadata
I20260811 11:49:11.138594 10379 ts_tablet_manager.cc:1918] T 487d7067e95040dc8c2e4a95eb37bc29 P 977178a42ba3401290cfcf409f2fa344: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:49:11.138695 10379 log.cc:1196] T 487d7067e95040dc8c2e4a95eb37bc29 P 977178a42ba3401290cfcf409f2fa344: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/487d7067e95040dc8c2e4a95eb37bc29
I20260811 11:49:11.138815 9777 catalog_manager.cc:4841] TS ad07640f942d42f1b3594a606bf2a30b (127.20.244.66:35499): tablet 487d7067e95040dc8c2e4a95eb37bc29 (table test-table [id=a74055464d3442dfa454efd001e8ecc5]) successfully deleted
I20260811 11:49:11.139046 10379 ts_tablet_manager.cc:1939] T 487d7067e95040dc8c2e4a95eb37bc29 P 977178a42ba3401290cfcf409f2fa344: Deleting consensus metadata
I20260811 11:49:11.140180 9777 catalog_manager.cc:4841] TS 977178a42ba3401290cfcf409f2fa344 (127.20.244.67:42521): tablet 487d7067e95040dc8c2e4a95eb37bc29 (table test-table [id=a74055464d3442dfa454efd001e8ecc5]) successfully deleted
W20260811 11:49:11.141578 9777 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.244.65:43467 (error 108)
I20260811 11:49:11.141852 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 10023
I20260811 11:49:11.147766 10342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:11.147456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:43467 (local address 127.0.0.1:50088)
0811 11:49:11.147606 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:11.147687 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.65:43467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 11:49:11.147935 9777 catalog_manager.cc:4584] TS 588b085262034ff7ba5d3521f72cb4c6 (127.20.244.65:43467): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 487d7067e95040dc8c2e4a95eb37bc29: Network error: Client connection negotiation failed: client connection to 127.20.244.65:43467: connect: Connection refused (error 111)
I20260811 11:49:11.152266 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 10180
I20260811 11:49:11.162443 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 9760
2026-08-11T11:49:11Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2651 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T11:49:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:11Z Disabled control of system clock
I20260811 11:49:11.200176 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:46107
--webserver_interface=127.20.244.126
--webserver_port=0
--builtin_ntp_servers=127.20.244.84:45331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:46107
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 11:49:11.322746 10388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:11.323028 10388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:11.323064 10388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:11.327190 10388 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:11.327293 10388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:11.327312 10388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:11.327330 10388 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:11.327350 10388 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:11.332176 10388 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:45331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:46107
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:46107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10388
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:11.333295 10388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:11.334694 10388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:11.343888 10394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:11.344161 10388 server_base.cc:1034] running on GCE node
W20260811 11:49:11.343891 10397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:11.343891 10395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:11.344926 10388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:11.346105 10388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:11.347433 10388 hybrid_clock.cc:648] HybridClock initialized: now 1786448951347396 us; error 54 us; skew 500 ppm
I20260811 11:49:11.349747 10388 webserver.cc:460] Webserver started at http://127.20.244.126:46353/ using document root <none> and password file <none>
I20260811 11:49:11.350469 10388 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:11.350579 10388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:11.350840 10388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:11.353255 10388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "8fc8b6031fe84ed9b9e56eda18f42cc4"
format_stamp: "Formatted at 2026-08-11 11:49:11 on dist-test-slave-vkjp"
server_key: "bdff4e0f218a4212b5fe15eab1ca054d"
server_key_iv: "0bffd11b0497ec07feb38605b8cb4a6d"
server_key_version: "encryptionkey@0"
I20260811 11:49:11.353893 10388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "8fc8b6031fe84ed9b9e56eda18f42cc4"
format_stamp: "Formatted at 2026-08-11 11:49:11 on dist-test-slave-vkjp"
server_key: "bdff4e0f218a4212b5fe15eab1ca054d"
server_key_iv: "0bffd11b0497ec07feb38605b8cb4a6d"
server_key_version: "encryptionkey@0"
I20260811 11:49:11.358094 10388 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 11:49:11.360881 10403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:11.362234 10388 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 11:49:11.362457 10388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "8fc8b6031fe84ed9b9e56eda18f42cc4"
format_stamp: "Formatted at 2026-08-11 11:49:11 on dist-test-slave-vkjp"
server_key: "bdff4e0f218a4212b5fe15eab1ca054d"
server_key_iv: "0bffd11b0497ec07feb38605b8cb4a6d"
server_key_version: "encryptionkey@0"
I20260811 11:49:11.362589 10388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:11.384430 10388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:11.385272 10388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:11.385496 10388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:11.393442 10388 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:46107
I20260811 11:49:11.393467 10459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:46107 every 8 connection(s)
I20260811 11:49:11.394433 10388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:11.397238 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 10388
I20260811 11:49:11.397361 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:11.397693 21457 external_mini_cluster.cc:1428] Setting key 97d564250ba068389fd43fc09be02f67
I20260811 11:49:11.397820 10460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:11.405782 10460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4: Bootstrap starting.
I20260811 11:49:11.408711 10460 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:11.409281 10463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:11.399289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40404 (local address 127.20.244.126:46107)
0811 11:49:11.400000 (+ 711us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:11.400022 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:11.400069 (+ 47us) server_negotiation.cc:407] Connection header received
0811 11:49:11.400904 (+ 835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:11.400930 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:11.401488 (+ 558us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:11.401882 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:11.402358 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:11.403826 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:11.404872 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:11.405603 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:11.405800 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:11.406828 (+ 1028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:11.406836 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:11.406852 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:11.407469 (+ 617us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:11.407546 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:11.407574 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:11.407689 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:11.407891 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 11:49:11.408194 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":131,"threads_started":1}
I20260811 11:49:11.409708 10460 log.cc:824] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:11.412103 10460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4: No bootstrap required, opened a new log
I20260811 11:49:11.415957 10460 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fc8b6031fe84ed9b9e56eda18f42cc4" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 46107 } }
I20260811 11:49:11.416254 10460 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:11.416292 10460 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fc8b6031fe84ed9b9e56eda18f42cc4, State: Initialized, Role: FOLLOWER
I20260811 11:49:11.416677 10460 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fc8b6031fe84ed9b9e56eda18f42cc4" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 46107 } }
I20260811 11:49:11.416800 10460 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:11.416848 10460 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:11.416924 10460 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:11.417909 10460 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fc8b6031fe84ed9b9e56eda18f42cc4" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 46107 } }
I20260811 11:49:11.418243 10460 leader_election.cc:302] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8fc8b6031fe84ed9b9e56eda18f42cc4; no voters:
I20260811 11:49:11.418526 10460 leader_election.cc:288] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:11.418689 10465 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:11.418957 10465 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4 [term 1 LEADER]: Becoming Leader. State: Replica: 8fc8b6031fe84ed9b9e56eda18f42cc4, State: Running, Role: LEADER
I20260811 11:49:11.419315 10465 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fc8b6031fe84ed9b9e56eda18f42cc4" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 46107 } }
I20260811 11:49:11.420012 10460 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:11.421144 10466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8fc8b6031fe84ed9b9e56eda18f42cc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fc8b6031fe84ed9b9e56eda18f42cc4" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 46107 } } }
I20260811 11:49:11.421293 10466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:11.421571 10467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fc8b6031fe84ed9b9e56eda18f42cc4. Latest consensus state: current_term: 1 leader_uuid: "8fc8b6031fe84ed9b9e56eda18f42cc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fc8b6031fe84ed9b9e56eda18f42cc4" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 46107 } } }
I20260811 11:49:11.421667 10467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:11.421948 10474 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:11.424955 10474 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:11.431581 10474 catalog_manager.cc:1347] Generated new cluster ID: 9235dbae0fa142ffbdb56044a59b0e3e
I20260811 11:49:11.431669 10474 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:11.454347 10474 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:11.455862 10474 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:11.461501 10474 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4: Generated new TSK 0
I20260811 11:49:11.462262 10474 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:49:11.476012 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:46107
--builtin_ntp_servers=127.20.244.84:45331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 11:49:11.597100 10485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:11.597409 10485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:11.597452 10485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:11.601742 10485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:11.601814 10485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:11.601872 10485 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:49:11.607029 10485 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:45331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:46107
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10485
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:11.608330 10485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:11.609807 10485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:11.620230 10493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:11.620276 10485 server_base.cc:1034] running on GCE node
W20260811 11:49:11.620223 10491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:11.620223 10490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:11.620976 10485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:11.621893 10485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:11.623145 10485 hybrid_clock.cc:648] HybridClock initialized: now 1786448951623052 us; error 46 us; skew 500 ppm
I20260811 11:49:11.625174 10485 webserver.cc:460] Webserver started at http://127.20.244.65:33523/ using document root <none> and password file <none>
I20260811 11:49:11.625813 10485 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:11.625882 10485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:11.626065 10485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:11.628317 10485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "48fc098396944feea975cce9a564c4bb"
format_stamp: "Formatted at 2026-08-11 11:49:11 on dist-test-slave-vkjp"
server_key: "bdc69674f285b299379f05cc5901c973"
server_key_iv: "e9971f58b290600c92ddcc51aaadef9d"
server_key_version: "encryptionkey@0"
I20260811 11:49:11.628892 10485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "48fc098396944feea975cce9a564c4bb"
format_stamp: "Formatted at 2026-08-11 11:49:11 on dist-test-slave-vkjp"
server_key: "bdc69674f285b299379f05cc5901c973"
server_key_iv: "e9971f58b290600c92ddcc51aaadef9d"
server_key_version: "encryptionkey@0"
I20260811 11:49:11.632756 10485 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260811 11:49:11.635514 10500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:11.636940 10485 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 11:49:11.637107 10485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "48fc098396944feea975cce9a564c4bb"
format_stamp: "Formatted at 2026-08-11 11:49:11 on dist-test-slave-vkjp"
server_key: "bdc69674f285b299379f05cc5901c973"
server_key_iv: "e9971f58b290600c92ddcc51aaadef9d"
server_key_version: "encryptionkey@0"
I20260811 11:49:11.637252 10485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:11.667033 10485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:11.667853 10485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:11.668023 10485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:11.668603 10485 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:49:11.669553 10485 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:49:11.669602 10485 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:11.669643 10485 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:49:11.669659 10485 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:11.679914 10485 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:36981
I20260811 11:49:11.679911 10634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:36981 every 8 connection(s)
I20260811 11:49:11.681438 10485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:49:11.684288 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 10485
I20260811 11:49:11.684465 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:49:11.684828 21457 external_mini_cluster.cc:1428] Setting key 97ecbc5ed8af98b31db52fe6732be359
I20260811 11:49:11.687000 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:46107
--builtin_ntp_servers=127.20.244.84:45331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 11:49:11.692979 10463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:11.683526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:52489 (local address 127.20.244.126:46107)
0811 11:49:11.683721 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:11.683725 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:11.684830 (+ 1105us) server_negotiation.cc:407] Connection header received
0811 11:49:11.686494 (+ 1664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:11.686497 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:11.686555 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:11.686637 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:11.687729 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:11.688275 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:11.690250 (+ 1975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:11.690681 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:11.690815 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:11.692261 (+ 1446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:11.692267 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:11.692271 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:11.692290 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:11.692318 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:11.692333 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:11.692425 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:11.692637 (+ 212us) server_negotiation.cc:299] Negotiation successful
0811 11:49:11.692749 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 11:49:11.693882 10637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:11.683844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:46107 (local address 127.20.244.65:52489)
0811 11:49:11.684670 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:11.684716 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:11.686259 (+ 1543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:11.686818 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:11.686825 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:11.686928 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:11.687579 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:11.687594 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:11.688430 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:11.688434 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:11.690090 (+ 1656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:11.690106 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:11.690888 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:11.690891 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:11.691055 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:11.691916 (+ 861us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:49:11.691918 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:11.691966 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:49:11.692050 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:11.692452 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:11.692462 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:11.692467 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 11:49:11.692601 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 11:49:11.692876 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":180,"threads_started":1}
I20260811 11:49:11.695465 10635 heartbeater.cc:347] Connected to a master server at 127.20.244.126:46107
I20260811 11:49:11.695789 10635 heartbeater.cc:464] Registering TS with master...
I20260811 11:49:11.696563 10635 heartbeater.cc:511] Master 127.20.244.126:46107 requested a full tablet report, sending...
I20260811 11:49:11.698451 10421 ts_manager.cc:194] Registered new tserver with Master: 48fc098396944feea975cce9a564c4bb (127.20.244.65:36981)
I20260811 11:49:11.699808 10421 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.244.65:52489
W20260811 11:49:11.807503 10638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:11.807791 10638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:11.807832 10638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:11.812076 10638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:11.812147 10638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:11.812206 10638 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:49:11.817171 10638 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:45331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:46107
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:11.818315 10638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:11.819756 10638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:49:11.830013 10638 server_base.cc:1034] running on GCE node
W20260811 11:49:11.829957 10646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:11.829984 10645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:11.829957 10649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:11.830781 10638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:11.831564 10638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:11.832758 10638 hybrid_clock.cc:648] HybridClock initialized: now 1786448951832725 us; error 44 us; skew 500 ppm
I20260811 11:49:11.834846 10638 webserver.cc:460] Webserver started at http://127.20.244.66:38315/ using document root <none> and password file <none>
I20260811 11:49:11.835561 10638 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:11.835633 10638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:11.835896 10638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:11.838201 10638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "41a25f72e0f64d34acd90ad8279aae5a"
format_stamp: "Formatted at 2026-08-11 11:49:11 on dist-test-slave-vkjp"
server_key: "8c9acdbc82cc4de978ea54feb6166a6a"
server_key_iv: "5e5308079d10e51c32cf507135205ceb"
server_key_version: "encryptionkey@0"
I20260811 11:49:11.838860 10638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "41a25f72e0f64d34acd90ad8279aae5a"
format_stamp: "Formatted at 2026-08-11 11:49:11 on dist-test-slave-vkjp"
server_key: "8c9acdbc82cc4de978ea54feb6166a6a"
server_key_iv: "5e5308079d10e51c32cf507135205ceb"
server_key_version: "encryptionkey@0"
I20260811 11:49:11.843204 10638 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 11:49:11.845973 10655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:11.847561 10638 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:49:11.847724 10638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "41a25f72e0f64d34acd90ad8279aae5a"
format_stamp: "Formatted at 2026-08-11 11:49:11 on dist-test-slave-vkjp"
server_key: "8c9acdbc82cc4de978ea54feb6166a6a"
server_key_iv: "5e5308079d10e51c32cf507135205ceb"
server_key_version: "encryptionkey@0"
I20260811 11:49:11.847877 10638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:11.864987 10638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:11.865851 10638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:11.866071 10638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:11.866818 10638 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:49:11.867945 10638 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:49:11.868026 10638 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:11.868103 10638 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:49:11.868139 10638 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:11.877475 10638 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:35433
I20260811 11:49:11.877493 10786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:35433 every 8 connection(s)
I20260811 11:49:11.878506 10638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:49:11.886242 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 10638
I20260811 11:49:11.886408 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:49:11.886795 21457 external_mini_cluster.cc:1428] Setting key a6b0e796a8e667c352c07ed49c3c4040
I20260811 11:49:11.888442 10463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:11.880498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:46583 (local address 127.20.244.126:46107)
0811 11:49:11.880637 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:11.880641 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:11.881744 (+ 1103us) server_negotiation.cc:407] Connection header received
0811 11:49:11.883268 (+ 1524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:11.883271 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:11.883327 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:11.883416 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:11.884361 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:11.884969 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:11.886145 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:11.886374 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:11.886535 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:11.887872 (+ 1337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:11.887876 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:11.887879 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:11.887893 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:11.887916 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:11.887926 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:11.888009 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:11.888188 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 11:49:11.888244 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 11:49:11.889283 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:46107
--builtin_ntp_servers=127.20.244.84:45331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 11:49:11.889583 10789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:11.880897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:46107 (local address 127.20.244.66:46583)
0811 11:49:11.881587 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:11.881630 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:11.882990 (+ 1360us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:11.883583 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:11.883589 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:11.883672 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:11.884188 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:11.884201 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:11.885088 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:11.885090 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:11.886010 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:11.886020 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:11.886626 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:11.886631 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:11.886877 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:11.887564 (+ 687us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:49:11.887566 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:11.887618 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:49:11.887687 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:11.888038 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:11.888048 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:11.888054 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 11:49:11.888180 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 11:49:11.888507 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":133,"threads_started":1}
I20260811 11:49:11.891746 10787 heartbeater.cc:347] Connected to a master server at 127.20.244.126:46107
I20260811 11:49:11.892014 10787 heartbeater.cc:464] Registering TS with master...
I20260811 11:49:11.892563 10787 heartbeater.cc:511] Master 127.20.244.126:46107 requested a full tablet report, sending...
I20260811 11:49:11.893658 10421 ts_manager.cc:194] Registered new tserver with Master: 41a25f72e0f64d34acd90ad8279aae5a (127.20.244.66:35433)
I20260811 11:49:11.894328 10421 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.244.66:46583
W20260811 11:49:12.011027 10790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:12.011366 10790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:12.011461 10790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:12.015740 10790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:12.015815 10790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:12.015959 10790 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:49:12.021430 10790 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:45331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:46107
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10790
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:12.022728 10790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:12.024260 10790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:12.034749 10797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:12.034862 10796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:12.034822 10790 server_base.cc:1034] running on GCE node
W20260811 11:49:12.034777 10799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:12.035517 10790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:12.036238 10790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:12.037458 10790 hybrid_clock.cc:648] HybridClock initialized: now 1786448952037426 us; error 50 us; skew 500 ppm
I20260811 11:49:12.039564 10790 webserver.cc:460] Webserver started at http://127.20.244.67:44855/ using document root <none> and password file <none>
I20260811 11:49:12.040196 10790 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:12.040303 10790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:12.040549 10790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:12.042855 10790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "6540c6e962f5478ea71e199b26246920"
format_stamp: "Formatted at 2026-08-11 11:49:12 on dist-test-slave-vkjp"
server_key: "d2815b6ea57c98448399c80d2af35226"
server_key_iv: "eaaf37ba5ac1d4b6c1270a28f3323c7a"
server_key_version: "encryptionkey@0"
I20260811 11:49:12.043542 10790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "6540c6e962f5478ea71e199b26246920"
format_stamp: "Formatted at 2026-08-11 11:49:12 on dist-test-slave-vkjp"
server_key: "d2815b6ea57c98448399c80d2af35226"
server_key_iv: "eaaf37ba5ac1d4b6c1270a28f3323c7a"
server_key_version: "encryptionkey@0"
I20260811 11:49:12.047773 10790 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 11:49:12.050562 10806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:12.052103 10790 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:49:12.052258 10790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "6540c6e962f5478ea71e199b26246920"
format_stamp: "Formatted at 2026-08-11 11:49:12 on dist-test-slave-vkjp"
server_key: "d2815b6ea57c98448399c80d2af35226"
server_key_iv: "eaaf37ba5ac1d4b6c1270a28f3323c7a"
server_key_version: "encryptionkey@0"
I20260811 11:49:12.052394 10790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:12.068396 10790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:12.069161 10790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:12.069377 10790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:12.070003 10790 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:49:12.070991 10790 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:49:12.071040 10790 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:12.071136 10790 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:49:12.071169 10790 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:12.080289 10790 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:36035
I20260811 11:49:12.080489 10946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:36035 every 8 connection(s)
I20260811 11:49:12.081311 10790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:49:12.087700 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 10790
I20260811 11:49:12.087823 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:49:12.088138 21457 external_mini_cluster.cc:1428] Setting key f8ab71448f56b26ea9b3e22700d9780c
I20260811 11:49:12.091965 10463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:12.083431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:59809 (local address 127.20.244.126:46107)
0811 11:49:12.083578 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:12.083582 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:12.084863 (+ 1281us) server_negotiation.cc:407] Connection header received
0811 11:49:12.086271 (+ 1408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:12.086274 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:12.086368 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:12.086461 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:12.087474 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.088301 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.089755 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.090067 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.090176 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:12.091525 (+ 1349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:12.091528 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:12.091530 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:12.091543 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:12.091562 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:12.091569 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:12.091630 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:12.091776 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 11:49:12.091849 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 11:49:12.092880 10949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:12.083978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:46107 (local address 127.20.244.67:59809)
0811 11:49:12.084698 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:12.084741 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:12.086035 (+ 1294us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:12.086620 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:12.086627 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:12.086710 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:12.087295 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:12.087311 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.088438 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.088441 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:12.089601 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:12.089612 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.090234 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.090237 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:12.090442 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:12.091253 (+ 811us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:49:12.091255 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:12.091307 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:49:12.091376 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:12.091646 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:12.091653 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:12.091658 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 11:49:12.091758 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 11:49:12.092037 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":127,"threads_started":1}
I20260811 11:49:12.094213 10947 heartbeater.cc:347] Connected to a master server at 127.20.244.126:46107
I20260811 11:49:12.094434 10947 heartbeater.cc:464] Registering TS with master...
I20260811 11:49:12.094987 10947 heartbeater.cc:511] Master 127.20.244.126:46107 requested a full tablet report, sending...
I20260811 11:49:12.096203 10421 ts_manager.cc:194] Registered new tserver with Master: 6540c6e962f5478ea71e199b26246920 (127.20.244.67:36035)
I20260811 11:49:12.096803 10421 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.244.67:59809
I20260811 11:49:12.102660 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:49:12.108788 10463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:12.104736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40414 (local address 127.20.244.126:46107)
0811 11:49:12.104917 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:12.104922 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:12.105061 (+ 139us) server_negotiation.cc:407] Connection header received
0811 11:49:12.105218 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:12.105221 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:12.105267 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:12.105349 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:12.105649 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.106179 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.107039 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.107326 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.107436 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:12.108344 (+ 908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:12.108348 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:12.108351 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:12.108365 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:12.108392 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:12.108400 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:12.108480 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:12.108576 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 11:49:12.108630 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 11:49:12.111971 10421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40414:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:49:12.115279 10421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:49:12.130890 10962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:12.125241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59154 (local address 127.20.244.65:36981)
0811 11:49:12.125920 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:12.125934 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:12.125959 (+ 25us) server_negotiation.cc:407] Connection header received
0811 11:49:12.126088 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:12.126093 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:12.126307 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:12.126872 (+ 565us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:12.127013 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.128116 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.129661 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.130194 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.130315 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:12.130523 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:12.130623 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 11:49:12.130721 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":117,"threads_started":1}
I20260811 11:49:12.130885 10960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:12.125133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:36981 (local address 127.0.0.1:59154)
0811 11:49:12.125665 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:12.125714 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:12.125869 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:12.126513 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:12.126519 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:12.126544 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:12.126703 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:12.126713 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.128236 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.128239 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:12.129517 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:12.129528 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.130328 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.130332 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:12.130439 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:12.130486 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 11:49:12.130596 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 11:49:12.130721 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"mutex_wait_us":28,"thread_start_us":113,"threads_started":1}
I20260811 11:49:12.132550 10963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:12.125893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:35433 (local address 127.0.0.1:36918)
0811 11:49:12.126873 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:12.126885 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:12.127010 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:12.127519 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:12.127522 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:12.127540 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:12.127633 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:12.127639 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.129018 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.129021 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:12.130387 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:12.130398 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.131714 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.131717 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:12.132224 (+ 507us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:12.132250 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 11:49:12.132329 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 11:49:12.132400 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":918,"mutex_wait_us":130,"thread_start_us":100,"threads_started":1}
I20260811 11:49:12.132787 10965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:12.126509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36918 (local address 127.20.244.66:35433)
0811 11:49:12.126807 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:12.126827 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:12.126983 (+ 156us) server_negotiation.cc:407] Connection header received
0811 11:49:12.127146 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:12.127150 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:12.127346 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:12.127492 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:12.127739 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.128878 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.130535 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.131579 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.131698 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:12.131877 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:12.132384 (+ 507us) server_negotiation.cc:299] Negotiation successful
0811 11:49:12.132494 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":117,"threads_started":1}
I20260811 11:49:12.133302 10961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:12.125179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:36035 (local address 127.0.0.1:60158)
0811 11:49:12.126702 (+ 1523us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:12.126715 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:12.126809 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:12.127437 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:12.127443 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:12.127463 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:12.127563 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:12.127570 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.129018 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.129021 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:12.130388 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:12.130398 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.131965 (+ 1567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.131969 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:12.132987 (+ 1018us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:12.133010 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 11:49:12.133095 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 11:49:12.133164 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1463,"mutex_wait_us":701,"thread_start_us":120,"threads_started":1}
I20260811 11:49:12.133414 10964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:12.126140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60158 (local address 127.20.244.67:36035)
0811 11:49:12.126555 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:12.126566 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:12.126900 (+ 334us) server_negotiation.cc:407] Connection header received
0811 11:49:12.126991 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:12.126997 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:12.127216 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:12.127361 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:12.127670 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.128878 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.130534 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.131861 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.131963 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:12.132143 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:12.133148 (+ 1005us) server_negotiation.cc:299] Negotiation successful
0811 11:49:12.133253 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":100,"threads_started":1}
I20260811 11:49:12.134325 10562 tablet_service.cc:1467] Processing CreateTablet for tablet ef402046eb3f4447a56d9f1d8d9d6b4c (DEFAULT_TABLE table=test-table [id=009cb5c3292b406ebb30ffacfbc000fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:49:12.135550 10562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef402046eb3f4447a56d9f1d8d9d6b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:12.135699 10711 tablet_service.cc:1467] Processing CreateTablet for tablet ef402046eb3f4447a56d9f1d8d9d6b4c (DEFAULT_TABLE table=test-table [id=009cb5c3292b406ebb30ffacfbc000fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:49:12.136004 10867 tablet_service.cc:1467] Processing CreateTablet for tablet ef402046eb3f4447a56d9f1d8d9d6b4c (DEFAULT_TABLE table=test-table [id=009cb5c3292b406ebb30ffacfbc000fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:49:12.136730 10711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef402046eb3f4447a56d9f1d8d9d6b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:12.136987 10867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef402046eb3f4447a56d9f1d8d9d6b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:12.143211 10966 tablet_bootstrap.cc:492] T ef402046eb3f4447a56d9f1d8d9d6b4c P 6540c6e962f5478ea71e199b26246920: Bootstrap starting.
I20260811 11:49:12.144106 10968 tablet_bootstrap.cc:492] T ef402046eb3f4447a56d9f1d8d9d6b4c P 41a25f72e0f64d34acd90ad8279aae5a: Bootstrap starting.
I20260811 11:49:12.144543 10967 tablet_bootstrap.cc:492] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb: Bootstrap starting.
I20260811 11:49:12.145642 10966 tablet_bootstrap.cc:654] T ef402046eb3f4447a56d9f1d8d9d6b4c P 6540c6e962f5478ea71e199b26246920: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:12.146234 10968 tablet_bootstrap.cc:654] T ef402046eb3f4447a56d9f1d8d9d6b4c P 41a25f72e0f64d34acd90ad8279aae5a: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:12.146449 10966 log.cc:824] T ef402046eb3f4447a56d9f1d8d9d6b4c P 6540c6e962f5478ea71e199b26246920: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:12.146549 10967 tablet_bootstrap.cc:654] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:12.147104 10968 log.cc:824] T ef402046eb3f4447a56d9f1d8d9d6b4c P 41a25f72e0f64d34acd90ad8279aae5a: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:12.147384 10967 log.cc:824] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:12.149230 10967 tablet_bootstrap.cc:492] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb: No bootstrap required, opened a new log
I20260811 11:49:12.149303 10968 tablet_bootstrap.cc:492] T ef402046eb3f4447a56d9f1d8d9d6b4c P 41a25f72e0f64d34acd90ad8279aae5a: No bootstrap required, opened a new log
I20260811 11:49:12.149300 10966 tablet_bootstrap.cc:492] T ef402046eb3f4447a56d9f1d8d9d6b4c P 6540c6e962f5478ea71e199b26246920: No bootstrap required, opened a new log
I20260811 11:49:12.149463 10967 ts_tablet_manager.cc:1397] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 11:49:12.149499 10968 ts_tablet_manager.cc:1397] T ef402046eb3f4447a56d9f1d8d9d6b4c P 41a25f72e0f64d34acd90ad8279aae5a: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 11:49:12.149494 10966 ts_tablet_manager.cc:1397] T ef402046eb3f4447a56d9f1d8d9d6b4c P 6540c6e962f5478ea71e199b26246920: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 11:49:12.153091 10967 raft_consensus.cc:348] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fc098396944feea975cce9a564c4bb" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 36981 } } peers { permanent_uuid: "6540c6e962f5478ea71e199b26246920" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 36035 } } peers { permanent_uuid: "41a25f72e0f64d34acd90ad8279aae5a" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35433 } }
I20260811 11:49:12.153362 10967 raft_consensus.cc:374] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:12.153416 10967 raft_consensus.cc:729] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fc098396944feea975cce9a564c4bb, State: Initialized, Role: FOLLOWER
I20260811 11:49:12.153919 10967 consensus_queue.cc:260] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fc098396944feea975cce9a564c4bb" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 36981 } } peers { permanent_uuid: "6540c6e962f5478ea71e199b26246920" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 36035 } } peers { permanent_uuid: "41a25f72e0f64d34acd90ad8279aae5a" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35433 } }
I20260811 11:49:12.153947 10968 raft_consensus.cc:348] T ef402046eb3f4447a56d9f1d8d9d6b4c P 41a25f72e0f64d34acd90ad8279aae5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fc098396944feea975cce9a564c4bb" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 36981 } } peers { permanent_uuid: "6540c6e962f5478ea71e199b26246920" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 36035 } } peers { permanent_uuid: "41a25f72e0f64d34acd90ad8279aae5a" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35433 } }
I20260811 11:49:12.153947 10966 raft_consensus.cc:348] T ef402046eb3f4447a56d9f1d8d9d6b4c P 6540c6e962f5478ea71e199b26246920 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fc098396944feea975cce9a564c4bb" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 36981 } } peers { permanent_uuid: "6540c6e962f5478ea71e199b26246920" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 36035 } } peers { permanent_uuid: "41a25f72e0f64d34acd90ad8279aae5a" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35433 } }
I20260811 11:49:12.154204 10968 raft_consensus.cc:374] T ef402046eb3f4447a56d9f1d8d9d6b4c P 41a25f72e0f64d34acd90ad8279aae5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:12.154204 10966 raft_consensus.cc:374] T ef402046eb3f4447a56d9f1d8d9d6b4c P 6540c6e962f5478ea71e199b26246920 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:12.154253 10968 raft_consensus.cc:729] T ef402046eb3f4447a56d9f1d8d9d6b4c P 41a25f72e0f64d34acd90ad8279aae5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41a25f72e0f64d34acd90ad8279aae5a, State: Initialized, Role: FOLLOWER
I20260811 11:49:12.154264 10966 raft_consensus.cc:729] T ef402046eb3f4447a56d9f1d8d9d6b4c P 6540c6e962f5478ea71e199b26246920 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6540c6e962f5478ea71e199b26246920, State: Initialized, Role: FOLLOWER
I20260811 11:49:12.154729 10968 consensus_queue.cc:260] T ef402046eb3f4447a56d9f1d8d9d6b4c P 41a25f72e0f64d34acd90ad8279aae5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fc098396944feea975cce9a564c4bb" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 36981 } } peers { permanent_uuid: "6540c6e962f5478ea71e199b26246920" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 36035 } } peers { permanent_uuid: "41a25f72e0f64d34acd90ad8279aae5a" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35433 } }
I20260811 11:49:12.154729 10966 consensus_queue.cc:260] T ef402046eb3f4447a56d9f1d8d9d6b4c P 6540c6e962f5478ea71e199b26246920 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fc098396944feea975cce9a564c4bb" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 36981 } } peers { permanent_uuid: "6540c6e962f5478ea71e199b26246920" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 36035 } } peers { permanent_uuid: "41a25f72e0f64d34acd90ad8279aae5a" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35433 } }
I20260811 11:49:12.155095 10967 ts_tablet_manager.cc:1428] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 11:49:12.155529 10635 heartbeater.cc:503] Master 127.20.244.126:46107 was elected leader, sending a full tablet report...
I20260811 11:49:12.155750 10966 ts_tablet_manager.cc:1428] T ef402046eb3f4447a56d9f1d8d9d6b4c P 6540c6e962f5478ea71e199b26246920: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 11:49:12.155750 10968 ts_tablet_manager.cc:1428] T ef402046eb3f4447a56d9f1d8d9d6b4c P 41a25f72e0f64d34acd90ad8279aae5a: Time spent starting tablet: real 0.006s user 0.002s sys 0.005s
I20260811 11:49:12.156085 10787 heartbeater.cc:503] Master 127.20.244.126:46107 was elected leader, sending a full tablet report...
I20260811 11:49:12.156093 10947 heartbeater.cc:503] Master 127.20.244.126:46107 was elected leader, sending a full tablet report...
W20260811 11:49:12.182677 10636 tablet.cc:2369] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:49:12.217319 10973 raft_consensus.cc:482] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:49:12.217600 10973 raft_consensus.cc:504] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fc098396944feea975cce9a564c4bb" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 36981 } } peers { permanent_uuid: "6540c6e962f5478ea71e199b26246920" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 36035 } } peers { permanent_uuid: "41a25f72e0f64d34acd90ad8279aae5a" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35433 } }
I20260811 11:49:12.218834 10973 leader_election.cc:288] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6540c6e962f5478ea71e199b26246920 (127.20.244.67:36035), 41a25f72e0f64d34acd90ad8279aae5a (127.20.244.66:35433)
I20260811 11:49:12.224453 10965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:12.219322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:42811 (local address 127.20.244.66:35433)
0811 11:49:12.219524 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:12.219528 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:12.219714 (+ 186us) server_negotiation.cc:407] Connection header received
0811 11:49:12.219778 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:12.219781 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:12.219827 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:12.219941 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:12.220470 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.221324 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.223011 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.223615 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.223731 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:12.223782 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:12.224197 (+ 415us) server_negotiation.cc:299] Negotiation successful
0811 11:49:12.224339 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260811 11:49:12.224447 10964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:12.219278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:60957 (local address 127.20.244.67:36035)
0811 11:49:12.219489 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:12.219494 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:12.219624 (+ 130us) server_negotiation.cc:407] Connection header received
0811 11:49:12.219769 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:12.219772 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:12.219827 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:12.219923 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:12.220470 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.221327 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.222957 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.223593 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.223731 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:12.223782 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:12.224197 (+ 415us) server_negotiation.cc:299] Negotiation successful
0811 11:49:12.224300 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260811 11:49:12.224494 10978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:12.219205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:35433 (local address 127.20.244.65:42811)
0811 11:49:12.219597 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:12.219610 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:12.219697 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:12.219956 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:12.219961 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:12.220021 (+ 60us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:12.220280 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:12.220288 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.221498 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.221501 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:12.222821 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:12.222833 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.223741 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.223745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:12.223993 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:12.224051 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 11:49:12.224133 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 11:49:12.224275 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"mutex_wait_us":228,"spinlock_wait_cycles":28928,"thread_start_us":119,"threads_started":1}
I20260811 11:49:12.224499 10977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:12.219183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:36035 (local address 127.20.244.65:60957)
0811 11:49:12.219498 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:12.219516 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:12.219651 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:12.219973 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:12.219975 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:12.220022 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:12.220280 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:12.220288 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.221467 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.221488 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:12.222825 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:12.222837 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.223741 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.223745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:12.223973 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:12.224048 (+ 75us) client_negotiation.cc:769] Sending connection context
0811 11:49:12.224133 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 11:49:12.224275 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":256,"spinlock_wait_cycles":30464,"thread_start_us":106,"threads_started":1}
I20260811 11:49:12.225308 10894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef402046eb3f4447a56d9f1d8d9d6b4c" candidate_uuid: "48fc098396944feea975cce9a564c4bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6540c6e962f5478ea71e199b26246920" is_pre_election: true
I20260811 11:49:12.225414 10734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef402046eb3f4447a56d9f1d8d9d6b4c" candidate_uuid: "48fc098396944feea975cce9a564c4bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41a25f72e0f64d34acd90ad8279aae5a" is_pre_election: true
I20260811 11:49:12.225687 10894 raft_consensus.cc:2454] T ef402046eb3f4447a56d9f1d8d9d6b4c P 6540c6e962f5478ea71e199b26246920 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48fc098396944feea975cce9a564c4bb in term 0.
I20260811 11:49:12.225687 10734 raft_consensus.cc:2454] T ef402046eb3f4447a56d9f1d8d9d6b4c P 41a25f72e0f64d34acd90ad8279aae5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48fc098396944feea975cce9a564c4bb in term 0.
I20260811 11:49:12.226256 10507 leader_election.cc:302] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 41a25f72e0f64d34acd90ad8279aae5a, 48fc098396944feea975cce9a564c4bb, 6540c6e962f5478ea71e199b26246920; no voters:
I20260811 11:49:12.226643 10973 raft_consensus.cc:2781] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:49:12.226728 10973 raft_consensus.cc:482] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:49:12.226802 10973 raft_consensus.cc:3037] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:12.227993 10973 raft_consensus.cc:504] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fc098396944feea975cce9a564c4bb" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 36981 } } peers { permanent_uuid: "6540c6e962f5478ea71e199b26246920" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 36035 } } peers { permanent_uuid: "41a25f72e0f64d34acd90ad8279aae5a" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35433 } }
I20260811 11:49:12.228371 10973 leader_election.cc:288] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb [CANDIDATE]: Term 1 election: Requested vote from peers 6540c6e962f5478ea71e199b26246920 (127.20.244.67:36035), 41a25f72e0f64d34acd90ad8279aae5a (127.20.244.66:35433)
I20260811 11:49:12.228760 10734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef402046eb3f4447a56d9f1d8d9d6b4c" candidate_uuid: "48fc098396944feea975cce9a564c4bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41a25f72e0f64d34acd90ad8279aae5a"
I20260811 11:49:12.228763 10894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef402046eb3f4447a56d9f1d8d9d6b4c" candidate_uuid: "48fc098396944feea975cce9a564c4bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6540c6e962f5478ea71e199b26246920"
I20260811 11:49:12.228873 10734 raft_consensus.cc:3037] T ef402046eb3f4447a56d9f1d8d9d6b4c P 41a25f72e0f64d34acd90ad8279aae5a [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:12.228902 10894 raft_consensus.cc:3037] T ef402046eb3f4447a56d9f1d8d9d6b4c P 6540c6e962f5478ea71e199b26246920 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:12.229947 10894 raft_consensus.cc:2454] T ef402046eb3f4447a56d9f1d8d9d6b4c P 6540c6e962f5478ea71e199b26246920 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fc098396944feea975cce9a564c4bb in term 1.
I20260811 11:49:12.229970 10734 raft_consensus.cc:2454] T ef402046eb3f4447a56d9f1d8d9d6b4c P 41a25f72e0f64d34acd90ad8279aae5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48fc098396944feea975cce9a564c4bb in term 1.
I20260811 11:49:12.230288 10507 leader_election.cc:302] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48fc098396944feea975cce9a564c4bb, 6540c6e962f5478ea71e199b26246920; no voters:
I20260811 11:49:12.230545 10973 raft_consensus.cc:2781] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:12.230788 10973 raft_consensus.cc:686] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb [term 1 LEADER]: Becoming Leader. State: Replica: 48fc098396944feea975cce9a564c4bb, State: Running, Role: LEADER
I20260811 11:49:12.231182 10973 consensus_queue.cc:237] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fc098396944feea975cce9a564c4bb" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 36981 } } peers { permanent_uuid: "6540c6e962f5478ea71e199b26246920" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 36035 } } peers { permanent_uuid: "41a25f72e0f64d34acd90ad8279aae5a" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35433 } }
I20260811 11:49:12.234573 10419 catalog_manager.cc:5495] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 48fc098396944feea975cce9a564c4bb (127.20.244.65). New cstate: current_term: 1 leader_uuid: "48fc098396944feea975cce9a564c4bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48fc098396944feea975cce9a564c4bb" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 36981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6540c6e962f5478ea71e199b26246920" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41a25f72e0f64d34acd90ad8279aae5a" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35433 } health_report { overall_health: UNKNOWN } } }
I20260811 11:49:12.255749 10962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:12.252193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59162 (local address 127.20.244.65:36981)
0811 11:49:12.252356 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:12.252360 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:12.252376 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:49:12.252562 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:12.252565 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:12.252628 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:12.252764 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:49:12.253012 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.253558 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.254382 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:12.254590 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:12.254673 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:12.254951 (+ 278us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:49:12.255417 (+ 466us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:49:12.255508 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:12.255585 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 11:49:12.255635 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 11:49:12.261881 10734 raft_consensus.cc:1261] T ef402046eb3f4447a56d9f1d8d9d6b4c P 41a25f72e0f64d34acd90ad8279aae5a [term 1 FOLLOWER]: Refusing update from remote peer 48fc098396944feea975cce9a564c4bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:49:12.261881 10894 raft_consensus.cc:1261] T ef402046eb3f4447a56d9f1d8d9d6b4c P 6540c6e962f5478ea71e199b26246920 [term 1 FOLLOWER]: Refusing update from remote peer 48fc098396944feea975cce9a564c4bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:49:12.262640 10973 consensus_queue.cc:1035] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6540c6e962f5478ea71e199b26246920" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:49:12.262858 10979 consensus_queue.cc:1035] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "41a25f72e0f64d34acd90ad8279aae5a" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:49:12.270884 10984 mvcc.cc:205] Tried to move back new op lower bound from 7317294908457324544 to 7317294908341792768. Current Snapshot: MvccSnapshot[applied={T|T < 7317294908457324544}]
I20260811 11:49:12.270905 10983 mvcc.cc:205] Tried to move back new op lower bound from 7317294908457324544 to 7317294908341792768. Current Snapshot: MvccSnapshot[applied={T|T < 7317294908457324544}]
I20260811 11:49:12.278823 10419 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:49:12.279054 10419 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:49:12.281565 10419 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8fc8b6031fe84ed9b9e56eda18f42cc4: Sending DeleteTablet for 3 replicas of tablet ef402046eb3f4447a56d9f1d8d9d6b4c
I20260811 11:49:12.282420 10867 tablet_service.cc:1514] Processing DeleteTablet for tablet ef402046eb3f4447a56d9f1d8d9d6b4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:49:12 UTC) from {username='slave'} at 127.0.0.1:60158
I20260811 11:49:12.282591 10562 tablet_service.cc:1514] Processing DeleteTablet for tablet ef402046eb3f4447a56d9f1d8d9d6b4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:49:12 UTC) from {username='slave'} at 127.0.0.1:59154
I20260811 11:49:12.283021 10994 tablet_replica.cc:330] T ef402046eb3f4447a56d9f1d8d9d6b4c P 6540c6e962f5478ea71e199b26246920: stopping tablet replica
I20260811 11:49:12.283030 10711 tablet_service.cc:1514] Processing DeleteTablet for tablet ef402046eb3f4447a56d9f1d8d9d6b4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:49:12 UTC) from {username='slave'} at 127.0.0.1:36918
I20260811 11:49:12.283309 10995 tablet_replica.cc:330] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb: stopping tablet replica
I20260811 11:49:12.283607 10994 raft_consensus.cc:2229] T ef402046eb3f4447a56d9f1d8d9d6b4c P 6540c6e962f5478ea71e199b26246920 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:49:12.283643 10995 raft_consensus.cc:2229] T ef402046eb3f4447a56d9f1d8d9d6b4c P 48fc098396944feea975cce9a564c4bb [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:49:12.283690 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 10485
I20260811 11:49:12.284468 10994 raft_consensus.cc:2258] T ef402046eb3f4447a56d9f1d8d9d6b4c P 6540c6e962f5478ea71e199b26246920 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:49:12.286942 10997 tablet_replica.cc:330] T ef402046eb3f4447a56d9f1d8d9d6b4c P 41a25f72e0f64d34acd90ad8279aae5a: stopping tablet replica
I20260811 11:49:12.287403 10997 raft_consensus.cc:2229] T ef402046eb3f4447a56d9f1d8d9d6b4c P 41a25f72e0f64d34acd90ad8279aae5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:49:12.287744 10997 raft_consensus.cc:2258] T ef402046eb3f4447a56d9f1d8d9d6b4c P 41a25f72e0f64d34acd90ad8279aae5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:49:12.288367 10994 ts_tablet_manager.cc:1905] T ef402046eb3f4447a56d9f1d8d9d6b4c P 6540c6e962f5478ea71e199b26246920: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:49:12.289184 10997 ts_tablet_manager.cc:1905] T ef402046eb3f4447a56d9f1d8d9d6b4c P 41a25f72e0f64d34acd90ad8279aae5a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:49:12.291407 10994 ts_tablet_manager.cc:1918] T ef402046eb3f4447a56d9f1d8d9d6b4c P 6540c6e962f5478ea71e199b26246920: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:49:12.291512 10994 log.cc:1196] T ef402046eb3f4447a56d9f1d8d9d6b4c P 6540c6e962f5478ea71e199b26246920: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/ef402046eb3f4447a56d9f1d8d9d6b4c
I20260811 11:49:12.291847 10994 ts_tablet_manager.cc:1939] T ef402046eb3f4447a56d9f1d8d9d6b4c P 6540c6e962f5478ea71e199b26246920: Deleting consensus metadata
I20260811 11:49:12.292096 10997 ts_tablet_manager.cc:1918] T ef402046eb3f4447a56d9f1d8d9d6b4c P 41a25f72e0f64d34acd90ad8279aae5a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:49:12.292191 10997 log.cc:1196] T ef402046eb3f4447a56d9f1d8d9d6b4c P 41a25f72e0f64d34acd90ad8279aae5a: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/ef402046eb3f4447a56d9f1d8d9d6b4c
I20260811 11:49:12.292502 10997 ts_tablet_manager.cc:1939] T ef402046eb3f4447a56d9f1d8d9d6b4c P 41a25f72e0f64d34acd90ad8279aae5a: Deleting consensus metadata
I20260811 11:49:12.293322 10407 catalog_manager.cc:4841] TS 6540c6e962f5478ea71e199b26246920 (127.20.244.67:36035): tablet ef402046eb3f4447a56d9f1d8d9d6b4c (table test-table [id=009cb5c3292b406ebb30ffacfbc000fa]) successfully deleted
W20260811 11:49:12.293685 10406 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.244.65:36981 (error 108)
I20260811 11:49:12.294031 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 10638
I20260811 11:49:12.294210 10406 catalog_manager.cc:4841] TS 41a25f72e0f64d34acd90ad8279aae5a (127.20.244.66:35433): tablet ef402046eb3f4447a56d9f1d8d9d6b4c (table test-table [id=009cb5c3292b406ebb30ffacfbc000fa]) successfully deleted
I20260811 11:49:12.294922 10961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:12.294521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:36981 (local address 127.0.0.1:59178)
0811 11:49:12.294720 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:12.294812 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.65:36981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
W20260811 11:49:12.295625 10406 catalog_manager.cc:4584] TS 48fc098396944feea975cce9a564c4bb (127.20.244.65:36981): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ef402046eb3f4447a56d9f1d8d9d6b4c: Network error: Client connection negotiation failed: client connection to 127.20.244.65:36981: connect: Connection refused (error 111)
I20260811 11:49:12.306437 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 10790
I20260811 11:49:12.314886 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 10388
2026-08-11T11:49:12Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1149 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:12 dist-test-slave-vkjp krb5kdc[11003](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:12 dist-test-slave-vkjp krb5kdc[11003](info): set up 2 sockets
Aug 11 11:49:12 dist-test-slave-vkjp krb5kdc[11003](info): commencing operation
krb5kdc: starting...
W20260811 11:49:13.468214 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:13 dist-test-slave-vkjp krb5kdc[11003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448953, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:49:13.610793 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:43809
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:33849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:43809
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:13.728044 11018 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:13.728374 11018 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:13.728451 11018 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:13.732574 11018 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:13.732685 11018 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:13.732724 11018 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:13.732764 11018 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:13.732800 11018 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:13.738278 11018 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:33849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:43809
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:43809
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11018
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:13.739553 11018 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:13.740666 11018 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:13.750106 11027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:13.750095 11024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:13.750174 11018 server_base.cc:1034] running on GCE node
W20260811 11:49:13.750114 11025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:13.750958 11018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:13.752287 11018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:13.753486 11018 hybrid_clock.cc:648] HybridClock initialized: now 1786448953753471 us; error 31 us; skew 500 ppm
Aug 11 11:49:13 dist-test-slave-vkjp krb5kdc[11003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448953, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:13.756532 11018 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:49:13.757658 11018 webserver.cc:460] Webserver started at http://127.20.244.126:34847/ using document root <none> and password file <none>
I20260811 11:49:13.758419 11018 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:13.758524 11018 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:13.758821 11018 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:13.762002 11018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "9f5cdf49d5e5456f914da904fa9d605d"
format_stamp: "Formatted at 2026-08-11 11:49:13 on dist-test-slave-vkjp"
server_key: "5d398e0f1378678c0da893f83987665b"
server_key_iv: "bc004816f9f0a2cc90014c01361b74dc"
server_key_version: "encryptionkey@0"
I20260811 11:49:13.762771 11018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "9f5cdf49d5e5456f914da904fa9d605d"
format_stamp: "Formatted at 2026-08-11 11:49:13 on dist-test-slave-vkjp"
server_key: "5d398e0f1378678c0da893f83987665b"
server_key_iv: "bc004816f9f0a2cc90014c01361b74dc"
server_key_version: "encryptionkey@0"
I20260811 11:49:13.768579 11018 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 11:49:13.771879 11036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:13.773629 11018 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 11:49:13.773782 11018 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "9f5cdf49d5e5456f914da904fa9d605d"
format_stamp: "Formatted at 2026-08-11 11:49:13 on dist-test-slave-vkjp"
server_key: "5d398e0f1378678c0da893f83987665b"
server_key_iv: "bc004816f9f0a2cc90014c01361b74dc"
server_key_version: "encryptionkey@0"
I20260811 11:49:13.773927 11018 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:13.815531 11018 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:13.819381 11018 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:13.819550 11018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:13.826481 11018 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:43809
I20260811 11:49:13.826587 11096 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:43809 every 8 connection(s)
I20260811 11:49:13.827564 11018 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:13.829159 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 11018
I20260811 11:49:13.829308 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:13.829659 21457 external_mini_cluster.cc:1428] Setting key 7713a42539524da62782b9d213ad4c71
I20260811 11:49:13.830817 11097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:13.836666 11097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d: Bootstrap starting.
Aug 11 11:49:13 dist-test-slave-vkjp krb5kdc[11003](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448953, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:49:13.839308 11097 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:13.840250 11097 log.cc:824] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:13.842329 11097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d: No bootstrap required, opened a new log
I20260811 11:49:13.844563 11100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:13.831185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49166 (local address 127.20.244.126:43809)
0811 11:49:13.831622 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:13.831638 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:13.831673 (+ 35us) server_negotiation.cc:407] Connection header received
0811 11:49:13.832341 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:13.832358 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:13.832670 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:13.833011 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:13.833876 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:13.834918 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:13.835838 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:13.836344 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:13.836518 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:13.839309 (+ 2791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:13.839314 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:13.839328 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:13.839380 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:13.841355 (+ 1975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:13.841869 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:13.841875 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:13.841880 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:13.842027 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:13.842436 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:13.842448 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:13.842449 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:13.842892 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:13.843207 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:13.843487 (+ 280us) server_negotiation.cc:299] Negotiation successful
0811 11:49:13.843811 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":152,"threads_started":1}
I20260811 11:49:13.846436 11097 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f5cdf49d5e5456f914da904fa9d605d" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 43809 } }
I20260811 11:49:13.846719 11097 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:13.846807 11097 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5cdf49d5e5456f914da904fa9d605d, State: Initialized, Role: FOLLOWER
I20260811 11:49:13.847287 11097 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f5cdf49d5e5456f914da904fa9d605d" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 43809 } }
I20260811 11:49:13.847419 11097 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:13.847460 11097 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:13.847529 11097 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:13.848445 11097 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f5cdf49d5e5456f914da904fa9d605d" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 43809 } }
I20260811 11:49:13.848743 11097 leader_election.cc:302] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f5cdf49d5e5456f914da904fa9d605d; no voters:
I20260811 11:49:13.849030 11097 leader_election.cc:288] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:13.849224 11103 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:13.849593 11103 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d [term 1 LEADER]: Becoming Leader. State: Replica: 9f5cdf49d5e5456f914da904fa9d605d, State: Running, Role: LEADER
I20260811 11:49:13.849936 11103 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f5cdf49d5e5456f914da904fa9d605d" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 43809 } }
I20260811 11:49:13.850390 11097 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:13.851864 11104 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f5cdf49d5e5456f914da904fa9d605d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f5cdf49d5e5456f914da904fa9d605d" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 43809 } } }
I20260811 11:49:13.852020 11104 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:13.852399 11105 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f5cdf49d5e5456f914da904fa9d605d. Latest consensus state: current_term: 1 leader_uuid: "9f5cdf49d5e5456f914da904fa9d605d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f5cdf49d5e5456f914da904fa9d605d" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 43809 } } }
I20260811 11:49:13.852504 11105 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:13.852638 11114 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:13.855937 11114 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:13.861631 11114 catalog_manager.cc:1347] Generated new cluster ID: dddae5cb80014a698ecff3e29e2f6bbb
I20260811 11:49:13.861721 11114 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:13.869843 11114 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:13.870780 11114 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:13.877992 11114 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d: Generated new TSK 0
I20260811 11:49:13.878902 11114 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.244.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
I20260811 11:49:13.922385 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:43809
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:33849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:14.039474 11127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:14.039734 11127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:14.039777 11127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:14.043705 11127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:14.043763 11127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:14.043820 11127 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:49:14.049072 11127 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:33849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:43809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11127
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:14.050170 11127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:14.051275 11127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:14.061707 11135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:14.061827 11132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:14.061717 11133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:14.062791 11127 server_base.cc:1034] running on GCE node
I20260811 11:49:14.063341 11127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:14.064030 11127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:14.065198 11127 hybrid_clock.cc:648] HybridClock initialized: now 1786448954065179 us; error 40 us; skew 500 ppm
Aug 11 11:49:14 dist-test-slave-vkjp krb5kdc[11003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448954, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:14.068125 11127 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:49:14.069051 11127 webserver.cc:460] Webserver started at http://127.20.244.65:40509/ using document root <none> and password file <none>
I20260811 11:49:14.069656 11127 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:14.069716 11127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:14.069958 11127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:14.072109 11127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "680a4d6338774cb19f50fba4781c6f95"
format_stamp: "Formatted at 2026-08-11 11:49:14 on dist-test-slave-vkjp"
server_key: "adf1b72afea28250250e8571727d6680"
server_key_iv: "cc72079e8a5793f7f9d7ce1e286b41e1"
server_key_version: "encryptionkey@0"
I20260811 11:49:14.072701 11127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "680a4d6338774cb19f50fba4781c6f95"
format_stamp: "Formatted at 2026-08-11 11:49:14 on dist-test-slave-vkjp"
server_key: "adf1b72afea28250250e8571727d6680"
server_key_iv: "cc72079e8a5793f7f9d7ce1e286b41e1"
server_key_version: "encryptionkey@0"
I20260811 11:49:14.076588 11127 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 11:49:14.079124 11143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:14.080614 11127 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 11:49:14.080755 11127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "680a4d6338774cb19f50fba4781c6f95"
format_stamp: "Formatted at 2026-08-11 11:49:14 on dist-test-slave-vkjp"
server_key: "adf1b72afea28250250e8571727d6680"
server_key_iv: "cc72079e8a5793f7f9d7ce1e286b41e1"
server_key_version: "encryptionkey@0"
I20260811 11:49:14.080891 11127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:14.104234 11127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:14.107640 11127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:14.107872 11127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:14.108513 11127 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:49:14.109407 11127 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:49:14.109479 11127 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:14.109553 11127 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:49:14.109609 11127 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:14.119374 11127 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:44919
I20260811 11:49:14.119405 11273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:44919 every 8 connection(s)
I20260811 11:49:14.120350 11127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
Aug 11 11:49:14 dist-test-slave-vkjp krb5kdc[11003](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448954, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:49:14.130525 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 11127
I20260811 11:49:14.130693 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:49:14.131006 21457 external_mini_cluster.cc:1428] Setting key 87db9d00d488a87a0f24af5b58574caa
I20260811 11:49:14.134586 11100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:14.122293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:36159 (local address 127.20.244.126:43809)
0811 11:49:14.122491 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:14.122495 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:14.123346 (+ 851us) server_negotiation.cc:407] Connection header received
0811 11:49:14.124713 (+ 1367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:14.124717 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:14.124776 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:14.124858 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:14.126018 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.126584 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.127778 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.128027 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.128166 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:14.130652 (+ 2486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:14.130656 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:14.130658 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:14.130684 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:14.132365 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:14.132986 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:14.132990 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:14.132992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:14.133083 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:14.133464 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:14.133467 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:14.133469 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:14.133659 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:14.133771 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:14.134265 (+ 494us) server_negotiation.cc:299] Negotiation successful
0811 11:49:14.134401 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260811 11:49:14.135506 11276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:14.122643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:43809 (local address 127.20.244.65:36159)
0811 11:49:14.123191 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:14.123237 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:14.124491 (+ 1254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:14.125043 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:14.125051 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:14.125391 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:14.125855 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:14.125868 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.126720 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.126726 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:14.127643 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:14.127653 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.128209 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.128213 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:14.128387 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:14.128939 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:14.128955 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:14.130472 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:14.132493 (+ 2021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:14.132499 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:14.132513 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:14.132824 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:14.133187 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:14.133191 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:14.133193 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:14.133335 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:14.133770 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:14.133778 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:14.134032 (+ 254us) client_negotiation.cc:769] Sending connection context
0811 11:49:14.134220 (+ 188us) client_negotiation.cc:240] Negotiation successful
0811 11:49:14.134552 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":114,"threads_started":1}
I20260811 11:49:14.136729 11274 heartbeater.cc:347] Connected to a master server at 127.20.244.126:43809
I20260811 11:49:14.136986 11274 heartbeater.cc:464] Registering TS with master...
I20260811 11:49:14.137616 11274 heartbeater.cc:511] Master 127.20.244.126:43809 requested a full tablet report, sending...
I20260811 11:49:14.139396 11050 ts_manager.cc:194] Registered new tserver with Master: 680a4d6338774cb19f50fba4781c6f95 (127.20.244.65:44919)
I20260811 11:49:14.140597 11050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:36159
WARNING: no policy specified for kudu/127.20.244.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
I20260811 11:49:14.163020 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:43809
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:33849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:14.280097 11279 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:14.280373 11279 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:14.280422 11279 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:14.284617 11279 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:14.284682 11279 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:14.284742 11279 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:49:14.290411 11279 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:33849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:43809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11279
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:14.291563 11279 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:14.292608 11279 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:14.302562 11288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:14.302542 11284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:14.302547 11285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:14.302912 11279 server_base.cc:1034] running on GCE node
I20260811 11:49:14.303440 11279 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:14.304123 11279 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:14.305310 11279 hybrid_clock.cc:648] HybridClock initialized: now 1786448954305280 us; error 46 us; skew 500 ppm
Aug 11 11:49:14 dist-test-slave-vkjp krb5kdc[11003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448954, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:14.308235 11279 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:49:14.309228 11279 webserver.cc:460] Webserver started at http://127.20.244.66:40991/ using document root <none> and password file <none>
I20260811 11:49:14.309824 11279 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:14.309917 11279 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:14.310159 11279 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:14.312304 11279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "64ad2a4d4adc4680b594b3a303c5ce2e"
format_stamp: "Formatted at 2026-08-11 11:49:14 on dist-test-slave-vkjp"
server_key: "622d47547e51d529ef8e354aabf3cb28"
server_key_iv: "dff3c3b33e2fd5b6ee22d36c79aa4e16"
server_key_version: "encryptionkey@0"
I20260811 11:49:14.312872 11279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "64ad2a4d4adc4680b594b3a303c5ce2e"
format_stamp: "Formatted at 2026-08-11 11:49:14 on dist-test-slave-vkjp"
server_key: "622d47547e51d529ef8e354aabf3cb28"
server_key_iv: "dff3c3b33e2fd5b6ee22d36c79aa4e16"
server_key_version: "encryptionkey@0"
I20260811 11:49:14.316629 11279 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 11:49:14.319205 11297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:14.320430 11279 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:49:14.320569 11279 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "64ad2a4d4adc4680b594b3a303c5ce2e"
format_stamp: "Formatted at 2026-08-11 11:49:14 on dist-test-slave-vkjp"
server_key: "622d47547e51d529ef8e354aabf3cb28"
server_key_iv: "dff3c3b33e2fd5b6ee22d36c79aa4e16"
server_key_version: "encryptionkey@0"
I20260811 11:49:14.320683 11279 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:14.333806 11279 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:14.337100 11279 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:14.337322 11279 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:14.337945 11279 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:49:14.338821 11279 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:49:14.338894 11279 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:14.338965 11279 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:49:14.339022 11279 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:14.348615 11279 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:37609
I20260811 11:49:14.348635 11427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:37609 every 8 connection(s)
I20260811 11:49:14.349575 11279 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:49:14.350564 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 11279
I20260811 11:49:14.350706 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:49:14.351024 21457 external_mini_cluster.cc:1428] Setting key 48076d7e547bff03c5a41f6081d9e102
Aug 11 11:49:14 dist-test-slave-vkjp krb5kdc[11003](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448954, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.244.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.67@KRBTEST.COM" created.
I20260811 11:49:14.366443 11100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:14.351853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:56687 (local address 127.20.244.126:43809)
0811 11:49:14.351987 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:14.351992 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:14.353270 (+ 1278us) server_negotiation.cc:407] Connection header received
0811 11:49:14.354674 (+ 1404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:14.354680 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:14.354748 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:14.354840 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:14.356527 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.357065 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.358955 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.359253 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.359342 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:14.362554 (+ 3212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:14.362557 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:14.362559 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:14.362586 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:14.364183 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:14.364740 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:14.364743 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:14.364744 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:14.364826 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:14.365157 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:14.365159 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:14.365161 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:14.365398 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:14.365481 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:14.366080 (+ 599us) server_negotiation.cc:299] Negotiation successful
0811 11:49:14.366241 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 11:49:14.367839 11430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:14.352389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:43809 (local address 127.20.244.66:56687)
0811 11:49:14.353120 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:14.353181 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:14.354421 (+ 1240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:14.355057 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:14.355069 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:14.355625 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:14.356360 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:14.356384 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.357203 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.357209 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:14.358825 (+ 1616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:14.358841 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.359435 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.359442 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:14.359707 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:14.360380 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:14.360404 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:14.362353 (+ 1949us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:14.364297 (+ 1944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:14.364302 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:14.364323 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:14.364648 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:14.364915 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:14.364918 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:14.364919 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:14.365058 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:14.365502 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:14.365508 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:14.365767 (+ 259us) client_negotiation.cc:769] Sending connection context
0811 11:49:14.365992 (+ 225us) client_negotiation.cc:240] Negotiation successful
0811 11:49:14.366386 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":180,"threads_started":1}
I20260811 11:49:14.369159 11428 heartbeater.cc:347] Connected to a master server at 127.20.244.126:43809
I20260811 11:49:14.369457 11428 heartbeater.cc:464] Registering TS with master...
I20260811 11:49:14.369993 11428 heartbeater.cc:511] Master 127.20.244.126:43809 requested a full tablet report, sending...
I20260811 11:49:14.371210 11050 ts_manager.cc:194] Registered new tserver with Master: 64ad2a4d4adc4680b594b3a303c5ce2e (127.20.244.66:37609)
I20260811 11:49:14.371845 11050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:56687
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
I20260811 11:49:14.386271 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:43809
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:33849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:14.503381 11433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:14.503664 11433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:14.503707 11433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:14.507699 11433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:14.507756 11433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:14.507855 11433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:49:14.513101 11433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:33849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:43809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:14.514243 11433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:14.515333 11433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:14.526084 11443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:14.526100 11439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:14.526084 11441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:14.526298 11433 server_base.cc:1034] running on GCE node
I20260811 11:49:14.526866 11433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:14.527598 11433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:14.528764 11433 hybrid_clock.cc:648] HybridClock initialized: now 1786448954528727 us; error 47 us; skew 500 ppm
Aug 11 11:49:14 dist-test-slave-vkjp krb5kdc[11003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448954, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:14.531657 11433 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:49:14.532591 11433 webserver.cc:460] Webserver started at http://127.20.244.67:38549/ using document root <none> and password file <none>
I20260811 11:49:14.533186 11433 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:14.533250 11433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:14.533495 11433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:14.536633 11433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "519db170eaca45309c54c59547ac7c7b"
format_stamp: "Formatted at 2026-08-11 11:49:14 on dist-test-slave-vkjp"
server_key: "3471a05f13e3642ca6cc9e64efdb610f"
server_key_iv: "4cdb3caf5153aa06a5e5526cd4b45206"
server_key_version: "encryptionkey@0"
I20260811 11:49:14.537418 11433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "519db170eaca45309c54c59547ac7c7b"
format_stamp: "Formatted at 2026-08-11 11:49:14 on dist-test-slave-vkjp"
server_key: "3471a05f13e3642ca6cc9e64efdb610f"
server_key_iv: "4cdb3caf5153aa06a5e5526cd4b45206"
server_key_version: "encryptionkey@0"
I20260811 11:49:14.543429 11433 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260811 11:49:14.546415 11451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:14.547751 11433 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:49:14.547902 11433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "519db170eaca45309c54c59547ac7c7b"
format_stamp: "Formatted at 2026-08-11 11:49:14 on dist-test-slave-vkjp"
server_key: "3471a05f13e3642ca6cc9e64efdb610f"
server_key_iv: "4cdb3caf5153aa06a5e5526cd4b45206"
server_key_version: "encryptionkey@0"
I20260811 11:49:14.548023 11433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:14.563781 11433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:14.566731 11433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:14.566956 11433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:14.567626 11433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:49:14.568485 11433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:49:14.568557 11433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:14.568629 11433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:49:14.568681 11433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:14.578181 11433 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:34661
I20260811 11:49:14.578207 11579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:34661 every 8 connection(s)
I20260811 11:49:14.579192 11433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:49:14.585233 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 11433
I20260811 11:49:14.585369 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:49:14.585726 21457 external_mini_cluster.cc:1428] Setting key 1e5b8a7539c94e068ce6b44ec5f14b25
Aug 11 11:49:14 dist-test-slave-vkjp krb5kdc[11003](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448954, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:49:14.593698 11100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:14.581146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:43647 (local address 127.20.244.126:43809)
0811 11:49:14.581289 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:14.581292 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:14.582158 (+ 866us) server_negotiation.cc:407] Connection header received
0811 11:49:14.583616 (+ 1458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:14.583620 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:14.583683 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:14.583761 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:14.584985 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.585677 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.587239 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.587467 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.587578 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:14.590228 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:14.590233 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:14.590236 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:14.590267 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:14.591920 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:14.592407 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:14.592410 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:14.592411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:14.592485 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:14.592779 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:14.592781 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:14.592782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:14.592952 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:14.593025 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:14.593482 (+ 457us) server_negotiation.cc:299] Negotiation successful
0811 11:49:14.593579 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 11:49:14.594604 11583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:14.581514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:43809 (local address 127.20.244.67:43647)
0811 11:49:14.582009 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:14.582052 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:14.583402 (+ 1350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:14.583925 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:14.583932 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:14.584281 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:14.584825 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:14.584845 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.585801 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.585805 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:14.587107 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:14.587118 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.587628 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.587632 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:14.587857 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:14.588481 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:14.588497 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:14.589956 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:14.592032 (+ 2076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:14.592037 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:14.592049 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:14.592307 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:14.592566 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:14.592568 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:14.592569 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:14.592700 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:14.593038 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:14.593042 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:14.593272 (+ 230us) client_negotiation.cc:769] Sending connection context
0811 11:49:14.593428 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 11:49:14.593671 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":148,"threads_started":1}
I20260811 11:49:14.595882 11581 heartbeater.cc:347] Connected to a master server at 127.20.244.126:43809
I20260811 11:49:14.596143 11581 heartbeater.cc:464] Registering TS with master...
I20260811 11:49:14.596647 11581 heartbeater.cc:511] Master 127.20.244.126:43809 requested a full tablet report, sending...
I20260811 11:49:14.597697 11050 ts_manager.cc:194] Registered new tserver with Master: 519db170eaca45309c54c59547ac7c7b (127.20.244.67:34661)
I20260811 11:49:14.598307 11050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:43647
I20260811 11:49:14.599781 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:49:14.609659 11100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:14.601890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49176 (local address 127.20.244.126:43809)
0811 11:49:14.602013 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:14.602016 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:14.602284 (+ 268us) server_negotiation.cc:407] Connection header received
0811 11:49:14.602450 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:14.602454 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:14.602504 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:14.602585 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:14.603343 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.603861 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.604695 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.604925 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.605031 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:14.606565 (+ 1534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:14.606569 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:14.606572 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:14.606596 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:14.607835 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:14.608338 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:14.608341 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:14.608345 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:14.608420 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:14.608748 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:14.608751 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:14.608753 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:14.608954 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:14.609111 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:14.609384 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 11:49:14.609479 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 11:49:14.613277 11054 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49176:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:49:14.616446 11054 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:49:14.631654 11598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:14.626294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49506 (local address 127.20.244.67:34661)
0811 11:49:14.626937 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:14.626949 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:14.626981 (+ 32us) server_negotiation.cc:407] Connection header received
0811 11:49:14.627059 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:14.627064 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:14.627303 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:14.627465 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:14.627830 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.628582 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.630202 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.630913 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.631050 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:14.631237 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:14.631403 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 11:49:14.631501 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":185,"threads_started":1}
I20260811 11:49:14.631824 11594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:14.625369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:44919 (local address 127.0.0.1:57402)
0811 11:49:14.626093 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:14.626143 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:14.626299 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:14.627162 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:14.627169 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:14.627193 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:14.627401 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:14.627410 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.629090 (+ 1680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.629094 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:14.630272 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:14.630282 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.631409 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.631412 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:14.631519 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:14.631539 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 11:49:14.631589 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 11:49:14.631662 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"mutex_wait_us":84,"spinlock_wait_cycles":1920,"thread_start_us":72,"threads_started":1}
I20260811 11:49:14.631645 11592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:14.625564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:34661 (local address 127.0.0.1:49506)
0811 11:49:14.626091 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:14.626148 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:14.626298 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:14.627588 (+ 1290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:14.627590 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:14.627604 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:14.627709 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:14.627713 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.628724 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.628728 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:14.630061 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:14.630072 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.631050 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.631054 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:14.631195 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:14.631234 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 11:49:14.631346 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 11:49:14.631480 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"mutex_wait_us":43,"spinlock_wait_cycles":7552,"thread_start_us":111,"threads_started":1}
I20260811 11:49:14.632195 11593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:14.625565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57402 (local address 127.20.244.65:44919)
0811 11:49:14.626594 (+ 1029us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:14.626609 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:14.626635 (+ 26us) server_negotiation.cc:407] Connection header received
0811 11:49:14.626718 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:14.626724 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:14.626949 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:14.627551 (+ 602us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:14.627693 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.628923 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.630398 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.631262 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.631746 (+ 484us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:14.631897 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:14.631944 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 11:49:14.632050 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":921,"thread_start_us":89,"threads_started":1}
I20260811 11:49:14.632694 11596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:14.625792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:37609 (local address 127.0.0.1:41952)
0811 11:49:14.626745 (+ 953us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:14.626758 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:14.626860 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:14.627555 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:14.627558 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:14.627573 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:14.627729 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:14.627737 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.629096 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.629100 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:14.630428 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:14.630438 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.631694 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.631700 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:14.632384 (+ 684us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:14.632410 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 11:49:14.632497 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 11:49:14.632565 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":896,"mutex_wait_us":86,"spinlock_wait_cycles":768,"thread_start_us":100,"threads_started":1}
I20260811 11:49:14.632781 11597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:14.626294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41952 (local address 127.20.244.66:37609)
0811 11:49:14.626747 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:14.626760 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:14.626954 (+ 194us) server_negotiation.cc:407] Connection header received
0811 11:49:14.627036 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:14.627042 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:14.627241 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:14.627389 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:14.627873 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.628962 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.630562 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.631395 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.631492 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:14.631633 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:14.632546 (+ 913us) server_negotiation.cc:299] Negotiation successful
0811 11:49:14.632648 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":157,"threads_started":1}
I20260811 11:49:14.634924 11198 tablet_service.cc:1467] Processing CreateTablet for tablet baf099faa86b4e75844d521bd6277a2d (DEFAULT_TABLE table=test-table [id=046ee272ed0a4e7d8c76ee294cfec9c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:49:14.634923 11506 tablet_service.cc:1467] Processing CreateTablet for tablet baf099faa86b4e75844d521bd6277a2d (DEFAULT_TABLE table=test-table [id=046ee272ed0a4e7d8c76ee294cfec9c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:49:14.635979 11198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baf099faa86b4e75844d521bd6277a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:14.635980 11506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baf099faa86b4e75844d521bd6277a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:14.642302 11599 tablet_bootstrap.cc:492] T baf099faa86b4e75844d521bd6277a2d P 680a4d6338774cb19f50fba4781c6f95: Bootstrap starting.
I20260811 11:49:14.643242 11600 tablet_bootstrap.cc:492] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b: Bootstrap starting.
I20260811 11:49:14.645238 11600 tablet_bootstrap.cc:654] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:14.645364 11352 tablet_service.cc:1467] Processing CreateTablet for tablet baf099faa86b4e75844d521bd6277a2d (DEFAULT_TABLE table=test-table [id=046ee272ed0a4e7d8c76ee294cfec9c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:49:14.646335 11352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baf099faa86b4e75844d521bd6277a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:14.646479 11600 log.cc:824] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:14.648864 11600 tablet_bootstrap.cc:492] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b: No bootstrap required, opened a new log
I20260811 11:49:14.648994 11599 tablet_bootstrap.cc:654] T baf099faa86b4e75844d521bd6277a2d P 680a4d6338774cb19f50fba4781c6f95: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:14.649080 11600 ts_tablet_manager.cc:1397] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 11:49:14.649887 11599 log.cc:824] T baf099faa86b4e75844d521bd6277a2d P 680a4d6338774cb19f50fba4781c6f95: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:14.652343 11599 tablet_bootstrap.cc:492] T baf099faa86b4e75844d521bd6277a2d P 680a4d6338774cb19f50fba4781c6f95: No bootstrap required, opened a new log
I20260811 11:49:14.652544 11599 ts_tablet_manager.cc:1397] T baf099faa86b4e75844d521bd6277a2d P 680a4d6338774cb19f50fba4781c6f95: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260811 11:49:14.653136 11600 raft_consensus.cc:348] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680a4d6338774cb19f50fba4781c6f95" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 44919 } } peers { permanent_uuid: "519db170eaca45309c54c59547ac7c7b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 34661 } } peers { permanent_uuid: "64ad2a4d4adc4680b594b3a303c5ce2e" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 37609 } }
I20260811 11:49:14.653442 11600 raft_consensus.cc:374] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:14.653532 11600 raft_consensus.cc:729] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 519db170eaca45309c54c59547ac7c7b, State: Initialized, Role: FOLLOWER
I20260811 11:49:14.654002 11600 consensus_queue.cc:260] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680a4d6338774cb19f50fba4781c6f95" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 44919 } } peers { permanent_uuid: "519db170eaca45309c54c59547ac7c7b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 34661 } } peers { permanent_uuid: "64ad2a4d4adc4680b594b3a303c5ce2e" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 37609 } }
I20260811 11:49:14.654582 11603 tablet_bootstrap.cc:492] T baf099faa86b4e75844d521bd6277a2d P 64ad2a4d4adc4680b594b3a303c5ce2e: Bootstrap starting.
I20260811 11:49:14.655159 11600 ts_tablet_manager.cc:1428] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260811 11:49:14.655558 11581 heartbeater.cc:503] Master 127.20.244.126:43809 was elected leader, sending a full tablet report...
I20260811 11:49:14.656896 11603 tablet_bootstrap.cc:654] T baf099faa86b4e75844d521bd6277a2d P 64ad2a4d4adc4680b594b3a303c5ce2e: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:14.657167 11599 raft_consensus.cc:348] T baf099faa86b4e75844d521bd6277a2d P 680a4d6338774cb19f50fba4781c6f95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680a4d6338774cb19f50fba4781c6f95" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 44919 } } peers { permanent_uuid: "519db170eaca45309c54c59547ac7c7b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 34661 } } peers { permanent_uuid: "64ad2a4d4adc4680b594b3a303c5ce2e" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 37609 } }
I20260811 11:49:14.657437 11599 raft_consensus.cc:374] T baf099faa86b4e75844d521bd6277a2d P 680a4d6338774cb19f50fba4781c6f95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:14.657490 11599 raft_consensus.cc:729] T baf099faa86b4e75844d521bd6277a2d P 680a4d6338774cb19f50fba4781c6f95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680a4d6338774cb19f50fba4781c6f95, State: Initialized, Role: FOLLOWER
I20260811 11:49:14.657989 11599 consensus_queue.cc:260] T baf099faa86b4e75844d521bd6277a2d P 680a4d6338774cb19f50fba4781c6f95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680a4d6338774cb19f50fba4781c6f95" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 44919 } } peers { permanent_uuid: "519db170eaca45309c54c59547ac7c7b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 34661 } } peers { permanent_uuid: "64ad2a4d4adc4680b594b3a303c5ce2e" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 37609 } }
I20260811 11:49:14.658062 11603 log.cc:824] T baf099faa86b4e75844d521bd6277a2d P 64ad2a4d4adc4680b594b3a303c5ce2e: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:14.659022 11274 heartbeater.cc:503] Master 127.20.244.126:43809 was elected leader, sending a full tablet report...
I20260811 11:49:14.659049 11599 ts_tablet_manager.cc:1428] T baf099faa86b4e75844d521bd6277a2d P 680a4d6338774cb19f50fba4781c6f95: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 11:49:14.660195 11605 raft_consensus.cc:482] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:49:14.660269 11603 tablet_bootstrap.cc:492] T baf099faa86b4e75844d521bd6277a2d P 64ad2a4d4adc4680b594b3a303c5ce2e: No bootstrap required, opened a new log
I20260811 11:49:14.660346 11605 raft_consensus.cc:504] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680a4d6338774cb19f50fba4781c6f95" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 44919 } } peers { permanent_uuid: "519db170eaca45309c54c59547ac7c7b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 34661 } } peers { permanent_uuid: "64ad2a4d4adc4680b594b3a303c5ce2e" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 37609 } }
I20260811 11:49:14.660467 11603 ts_tablet_manager.cc:1397] T baf099faa86b4e75844d521bd6277a2d P 64ad2a4d4adc4680b594b3a303c5ce2e: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 11:49:14.661557 11605 leader_election.cc:288] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 680a4d6338774cb19f50fba4781c6f95 (127.20.244.65:44919), 64ad2a4d4adc4680b594b3a303c5ce2e (127.20.244.66:37609)
I20260811 11:49:14.664733 11603 raft_consensus.cc:348] T baf099faa86b4e75844d521bd6277a2d P 64ad2a4d4adc4680b594b3a303c5ce2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680a4d6338774cb19f50fba4781c6f95" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 44919 } } peers { permanent_uuid: "519db170eaca45309c54c59547ac7c7b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 34661 } } peers { permanent_uuid: "64ad2a4d4adc4680b594b3a303c5ce2e" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 37609 } }
I20260811 11:49:14.665050 11603 raft_consensus.cc:374] T baf099faa86b4e75844d521bd6277a2d P 64ad2a4d4adc4680b594b3a303c5ce2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:14.665117 11603 raft_consensus.cc:729] T baf099faa86b4e75844d521bd6277a2d P 64ad2a4d4adc4680b594b3a303c5ce2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64ad2a4d4adc4680b594b3a303c5ce2e, State: Initialized, Role: FOLLOWER
I20260811 11:49:14.665676 11603 consensus_queue.cc:260] T baf099faa86b4e75844d521bd6277a2d P 64ad2a4d4adc4680b594b3a303c5ce2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680a4d6338774cb19f50fba4781c6f95" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 44919 } } peers { permanent_uuid: "519db170eaca45309c54c59547ac7c7b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 34661 } } peers { permanent_uuid: "64ad2a4d4adc4680b594b3a303c5ce2e" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 37609 } }
I20260811 11:49:14.666298 11583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:14.661775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:37609 (local address 127.20.244.67:58495)
0811 11:49:14.661954 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:14.661982 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:14.662074 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:14.662345 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:14.662348 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:14.662367 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:14.662494 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:14.662501 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.663551 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.663554 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:14.664835 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:14.664846 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.665852 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.665856 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:14.665971 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:14.665994 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 11:49:14.666069 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 11:49:14.666154 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"mutex_wait_us":3}
I20260811 11:49:14.666406 11428 heartbeater.cc:503] Master 127.20.244.126:43809 was elected leader, sending a full tablet report...
I20260811 11:49:14.666680 11597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:14.661936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:58495 (local address 127.20.244.66:37609)
0811 11:49:14.662050 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:14.662054 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:14.662069 (+ 15us) server_negotiation.cc:407] Connection header received
0811 11:49:14.662173 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:14.662177 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:14.662226 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:14.662312 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:14.662652 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.663434 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.664971 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.665616 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.665731 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:14.665787 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:14.666481 (+ 694us) server_negotiation.cc:299] Negotiation successful
0811 11:49:14.666573 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 11:49:14.666756 11593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:14.661973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:32871 (local address 127.20.244.65:44919)
0811 11:49:14.662089 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:14.662093 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:14.662656 (+ 563us) server_negotiation.cc:407] Connection header received
0811 11:49:14.662842 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:14.662845 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:14.662889 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:14.662934 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:14.663380 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.663922 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.665283 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.665876 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.665961 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:14.666022 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:14.666561 (+ 539us) server_negotiation.cc:299] Negotiation successful
0811 11:49:14.666639 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 11:49:14.667172 11608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:14.661775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:44919 (local address 127.20.244.67:32871)
0811 11:49:14.662569 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:14.662583 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:14.662718 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:14.663056 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:14.663059 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:14.663075 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:14.663237 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:14.663244 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.664039 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.664045 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:14.664965 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:14.664984 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.666175 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.666178 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:14.666274 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:14.666305 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 11:49:14.666880 (+ 575us) client_negotiation.cc:240] Negotiation successful
0811 11:49:14.666992 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":724,"mutex_wait_us":282,"thread_start_us":126,"threads_started":1}
I20260811 11:49:14.667270 11374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baf099faa86b4e75844d521bd6277a2d" candidate_uuid: "519db170eaca45309c54c59547ac7c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64ad2a4d4adc4680b594b3a303c5ce2e" is_pre_election: true
I20260811 11:49:14.667572 11374 raft_consensus.cc:2454] T baf099faa86b4e75844d521bd6277a2d P 64ad2a4d4adc4680b594b3a303c5ce2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 519db170eaca45309c54c59547ac7c7b in term 0.
I20260811 11:49:14.667742 11223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baf099faa86b4e75844d521bd6277a2d" candidate_uuid: "519db170eaca45309c54c59547ac7c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680a4d6338774cb19f50fba4781c6f95" is_pre_election: true
I20260811 11:49:14.668023 11603 ts_tablet_manager.cc:1428] T baf099faa86b4e75844d521bd6277a2d P 64ad2a4d4adc4680b594b3a303c5ce2e: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260811 11:49:14.668018 11223 raft_consensus.cc:2454] T baf099faa86b4e75844d521bd6277a2d P 680a4d6338774cb19f50fba4781c6f95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 519db170eaca45309c54c59547ac7c7b in term 0.
I20260811 11:49:14.668092 11453 leader_election.cc:302] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 519db170eaca45309c54c59547ac7c7b, 64ad2a4d4adc4680b594b3a303c5ce2e; no voters:
I20260811 11:49:14.668354 11605 raft_consensus.cc:2781] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:49:14.668454 11605 raft_consensus.cc:482] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:49:14.668497 11605 raft_consensus.cc:3037] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:14.669674 11605 raft_consensus.cc:504] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680a4d6338774cb19f50fba4781c6f95" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 44919 } } peers { permanent_uuid: "519db170eaca45309c54c59547ac7c7b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 34661 } } peers { permanent_uuid: "64ad2a4d4adc4680b594b3a303c5ce2e" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 37609 } }
I20260811 11:49:14.670089 11605 leader_election.cc:288] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b [CANDIDATE]: Term 1 election: Requested vote from peers 680a4d6338774cb19f50fba4781c6f95 (127.20.244.65:44919), 64ad2a4d4adc4680b594b3a303c5ce2e (127.20.244.66:37609)
I20260811 11:49:14.670435 11223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baf099faa86b4e75844d521bd6277a2d" candidate_uuid: "519db170eaca45309c54c59547ac7c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680a4d6338774cb19f50fba4781c6f95"
I20260811 11:49:14.670506 11374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baf099faa86b4e75844d521bd6277a2d" candidate_uuid: "519db170eaca45309c54c59547ac7c7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64ad2a4d4adc4680b594b3a303c5ce2e"
I20260811 11:49:14.670557 11223 raft_consensus.cc:3037] T baf099faa86b4e75844d521bd6277a2d P 680a4d6338774cb19f50fba4781c6f95 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:14.670648 11374 raft_consensus.cc:3037] T baf099faa86b4e75844d521bd6277a2d P 64ad2a4d4adc4680b594b3a303c5ce2e [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:14.671777 11374 raft_consensus.cc:2454] T baf099faa86b4e75844d521bd6277a2d P 64ad2a4d4adc4680b594b3a303c5ce2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 519db170eaca45309c54c59547ac7c7b in term 1.
I20260811 11:49:14.671780 11223 raft_consensus.cc:2454] T baf099faa86b4e75844d521bd6277a2d P 680a4d6338774cb19f50fba4781c6f95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 519db170eaca45309c54c59547ac7c7b in term 1.
I20260811 11:49:14.672113 11453 leader_election.cc:302] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 519db170eaca45309c54c59547ac7c7b, 64ad2a4d4adc4680b594b3a303c5ce2e; no voters:
I20260811 11:49:14.672293 11605 raft_consensus.cc:2781] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:14.672554 11605 raft_consensus.cc:686] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b [term 1 LEADER]: Becoming Leader. State: Replica: 519db170eaca45309c54c59547ac7c7b, State: Running, Role: LEADER
I20260811 11:49:14.672878 11605 consensus_queue.cc:237] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680a4d6338774cb19f50fba4781c6f95" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 44919 } } peers { permanent_uuid: "519db170eaca45309c54c59547ac7c7b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 34661 } } peers { permanent_uuid: "64ad2a4d4adc4680b594b3a303c5ce2e" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 37609 } }
I20260811 11:49:14.676133 11054 catalog_manager.cc:5495] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 519db170eaca45309c54c59547ac7c7b (127.20.244.67). New cstate: current_term: 1 leader_uuid: "519db170eaca45309c54c59547ac7c7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "680a4d6338774cb19f50fba4781c6f95" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 44919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "519db170eaca45309c54c59547ac7c7b" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 34661 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64ad2a4d4adc4680b594b3a303c5ce2e" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 37609 } health_report { overall_health: UNKNOWN } } }
I20260811 11:49:14.697198 11598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:14.693638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49520 (local address 127.20.244.67:34661)
0811 11:49:14.693765 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:14.693769 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:14.693783 (+ 14us) server_negotiation.cc:407] Connection header received
0811 11:49:14.693868 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:14.693870 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:14.693924 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:14.694012 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:49:14.694241 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.694730 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.695624 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:14.695850 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:14.695936 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:14.696354 (+ 418us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:49:14.696777 (+ 423us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:49:14.696917 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:14.697019 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 11:49:14.697055 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 11:49:14.703552 11374 raft_consensus.cc:1261] T baf099faa86b4e75844d521bd6277a2d P 64ad2a4d4adc4680b594b3a303c5ce2e [term 1 FOLLOWER]: Refusing update from remote peer 519db170eaca45309c54c59547ac7c7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:49:14.703552 11223 raft_consensus.cc:1261] T baf099faa86b4e75844d521bd6277a2d P 680a4d6338774cb19f50fba4781c6f95 [term 1 FOLLOWER]: Refusing update from remote peer 519db170eaca45309c54c59547ac7c7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:49:14.704227 11605 consensus_queue.cc:1035] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "64ad2a4d4adc4680b594b3a303c5ce2e" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 37609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:49:14.704442 11611 consensus_queue.cc:1035] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "680a4d6338774cb19f50fba4781c6f95" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 44919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:49:14.713686 11615 mvcc.cc:205] Tried to move back new op lower bound from 7317294918458384384 to 7317294918342774784. Current Snapshot: MvccSnapshot[applied={T|T < 7317294918458384384}]
I20260811 11:49:14.713980 11616 mvcc.cc:205] Tried to move back new op lower bound from 7317294918458384384 to 7317294918342774784. Current Snapshot: MvccSnapshot[applied={T|T < 7317294918458384384}]
I20260811 11:49:14.721288 11050 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:49:14.721519 11050 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:49:14.724480 11050 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9f5cdf49d5e5456f914da904fa9d605d: Sending DeleteTablet for 3 replicas of tablet baf099faa86b4e75844d521bd6277a2d
I20260811 11:49:14.725383 11198 tablet_service.cc:1514] Processing DeleteTablet for tablet baf099faa86b4e75844d521bd6277a2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:49:14 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:57402
I20260811 11:49:14.725390 11352 tablet_service.cc:1514] Processing DeleteTablet for tablet baf099faa86b4e75844d521bd6277a2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:49:14 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:41952
I20260811 11:49:14.725394 11506 tablet_service.cc:1514] Processing DeleteTablet for tablet baf099faa86b4e75844d521bd6277a2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:49:14 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:49506
I20260811 11:49:14.725958 11625 tablet_replica.cc:330] T baf099faa86b4e75844d521bd6277a2d P 680a4d6338774cb19f50fba4781c6f95: stopping tablet replica
I20260811 11:49:14.726192 11624 tablet_replica.cc:330] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b: stopping tablet replica
I20260811 11:49:14.726289 11625 raft_consensus.cc:2229] T baf099faa86b4e75844d521bd6277a2d P 680a4d6338774cb19f50fba4781c6f95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:49:14.726490 11624 raft_consensus.cc:2229] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:49:14.726649 11625 raft_consensus.cc:2258] T baf099faa86b4e75844d521bd6277a2d P 680a4d6338774cb19f50fba4781c6f95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:49:14.726886 11624 raft_consensus.cc:2258] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:49:14.727133 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 11127
I20260811 11:49:14.734939 11624 ts_tablet_manager.cc:1905] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:49:14.737834 11624 ts_tablet_manager.cc:1918] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:49:14.737938 11624 log.cc:1196] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/baf099faa86b4e75844d521bd6277a2d
I20260811 11:49:14.738279 11624 ts_tablet_manager.cc:1939] T baf099faa86b4e75844d521bd6277a2d P 519db170eaca45309c54c59547ac7c7b: Deleting consensus metadata
I20260811 11:49:14.739682 11039 catalog_manager.cc:4841] TS 519db170eaca45309c54c59547ac7c7b (127.20.244.67:34661): tablet baf099faa86b4e75844d521bd6277a2d (table test-table [id=046ee272ed0a4e7d8c76ee294cfec9c0]) successfully deleted
I20260811 11:49:14.743510 11626 tablet_replica.cc:330] T baf099faa86b4e75844d521bd6277a2d P 64ad2a4d4adc4680b594b3a303c5ce2e: stopping tablet replica
I20260811 11:49:14.743944 11626 raft_consensus.cc:2229] T baf099faa86b4e75844d521bd6277a2d P 64ad2a4d4adc4680b594b3a303c5ce2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:49:14.744307 11626 raft_consensus.cc:2258] T baf099faa86b4e75844d521bd6277a2d P 64ad2a4d4adc4680b594b3a303c5ce2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:49:14.746949 11626 ts_tablet_manager.cc:1905] T baf099faa86b4e75844d521bd6277a2d P 64ad2a4d4adc4680b594b3a303c5ce2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:49:14.749333 11626 ts_tablet_manager.cc:1918] T baf099faa86b4e75844d521bd6277a2d P 64ad2a4d4adc4680b594b3a303c5ce2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:49:14.749466 11626 log.cc:1196] T baf099faa86b4e75844d521bd6277a2d P 64ad2a4d4adc4680b594b3a303c5ce2e: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/baf099faa86b4e75844d521bd6277a2d
I20260811 11:49:14.749816 11626 ts_tablet_manager.cc:1939] T baf099faa86b4e75844d521bd6277a2d P 64ad2a4d4adc4680b594b3a303c5ce2e: Deleting consensus metadata
W20260811 11:49:14.750883 11037 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.244.65:44919 (error 108)
I20260811 11:49:14.751585 11038 catalog_manager.cc:4841] TS 64ad2a4d4adc4680b594b3a303c5ce2e (127.20.244.66:37609): tablet baf099faa86b4e75844d521bd6277a2d (table test-table [id=046ee272ed0a4e7d8c76ee294cfec9c0]) successfully deleted
I20260811 11:49:14.752182 11596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:14.751802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:44919 (local address 127.0.0.1:57416)
0811 11:49:14.752020 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:14.752091 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.65:44919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
W20260811 11:49:14.752372 11037 catalog_manager.cc:4584] TS 680a4d6338774cb19f50fba4781c6f95 (127.20.244.65:44919): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet baf099faa86b4e75844d521bd6277a2d: Network error: Client connection negotiation failed: client connection to 127.20.244.65:44919: connect: Connection refused (error 111)
I20260811 11:49:14.752575 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 11279
I20260811 11:49:14.763163 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 11433
I20260811 11:49:14.773676 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 11018
2026-08-11T11:49:14Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2459 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T11:49:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:14Z Disabled control of system clock
I20260811 11:49:14.810142 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:42263
--webserver_interface=127.20.244.126
--webserver_port=0
--builtin_ntp_servers=127.20.244.84:44621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:42263
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 11:49:14.925993 11632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:14.926282 11632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:14.926319 11632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:14.930342 11632 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:14.930406 11632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:14.930423 11632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:14.930441 11632 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:14.930456 11632 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:14.935226 11632 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:44621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:42263
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:42263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:14.936726 11632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:14.938297 11632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:14.947969 11640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:14.947999 11632 server_base.cc:1034] running on GCE node
W20260811 11:49:14.947969 11639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:14.948016 11642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:14.948939 11632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:14.950187 11632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:14.951418 11632 hybrid_clock.cc:648] HybridClock initialized: now 1786448954951387 us; error 52 us; skew 500 ppm
I20260811 11:49:14.953538 11632 webserver.cc:460] Webserver started at http://127.20.244.126:42341/ using document root <none> and password file <none>
I20260811 11:49:14.954150 11632 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:14.954249 11632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:14.954599 11632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:14.956794 11632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "651ea898404d4421b8fe5515b8712f73"
format_stamp: "Formatted at 2026-08-11 11:49:14 on dist-test-slave-vkjp"
server_key: "3bd6d45d323a05a8479c2742c9f07b2c"
server_key_iv: "eb1b960e2183cbdfa116b237afe9ff48"
server_key_version: "encryptionkey@0"
I20260811 11:49:14.957386 11632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "651ea898404d4421b8fe5515b8712f73"
format_stamp: "Formatted at 2026-08-11 11:49:14 on dist-test-slave-vkjp"
server_key: "3bd6d45d323a05a8479c2742c9f07b2c"
server_key_iv: "eb1b960e2183cbdfa116b237afe9ff48"
server_key_version: "encryptionkey@0"
I20260811 11:49:14.961551 11632 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 11:49:14.964190 11649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:14.965530 11632 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:49:14.965685 11632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "651ea898404d4421b8fe5515b8712f73"
format_stamp: "Formatted at 2026-08-11 11:49:14 on dist-test-slave-vkjp"
server_key: "3bd6d45d323a05a8479c2742c9f07b2c"
server_key_iv: "eb1b960e2183cbdfa116b237afe9ff48"
server_key_version: "encryptionkey@0"
I20260811 11:49:14.965816 11632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:15.001328 11632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:15.002144 11632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:15.002370 11632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:15.010084 11632 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:42263
I20260811 11:49:15.010116 11711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:42263 every 8 connection(s)
I20260811 11:49:15.011173 11632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:15.014463 11712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:15.017334 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 11632
I20260811 11:49:15.017490 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:15.017844 21457 external_mini_cluster.cc:1428] Setting key 11fcfe7718102f826db60d68e3da5106
I20260811 11:49:15.021195 11712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73: Bootstrap starting.
I20260811 11:49:15.023721 11712 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:15.024542 11712 log.cc:824] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:15.027035 11712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73: No bootstrap required, opened a new log
I20260811 11:49:15.027837 11717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:15.019377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55266 (local address 127.20.244.126:42263)
0811 11:49:15.020087 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:15.020101 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:15.020139 (+ 38us) server_negotiation.cc:407] Connection header received
0811 11:49:15.020752 (+ 613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:15.020769 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:15.021189 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:15.021585 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:15.022084 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.023052 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.024081 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.024581 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.024766 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:15.025762 (+ 996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:15.025767 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:15.025780 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:15.026165 (+ 385us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:15.026277 (+ 112us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:15.026385 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:15.026491 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:15.026683 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 11:49:15.026975 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":142,"threads_started":1}
I20260811 11:49:15.031507 11712 raft_consensus.cc:348] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "651ea898404d4421b8fe5515b8712f73" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 42263 } }
I20260811 11:49:15.031804 11712 raft_consensus.cc:374] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:15.031894 11712 raft_consensus.cc:729] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 651ea898404d4421b8fe5515b8712f73, State: Initialized, Role: FOLLOWER
I20260811 11:49:15.032399 11712 consensus_queue.cc:260] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "651ea898404d4421b8fe5515b8712f73" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 42263 } }
I20260811 11:49:15.032564 11712 raft_consensus.cc:388] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:15.032660 11712 raft_consensus.cc:482] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:15.032770 11712 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:15.033864 11712 raft_consensus.cc:504] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "651ea898404d4421b8fe5515b8712f73" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 42263 } }
I20260811 11:49:15.034281 11712 leader_election.cc:302] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 651ea898404d4421b8fe5515b8712f73; no voters:
I20260811 11:49:15.034682 11712 leader_election.cc:288] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:15.034888 11720 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:15.035158 11720 raft_consensus.cc:686] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73 [term 1 LEADER]: Becoming Leader. State: Replica: 651ea898404d4421b8fe5515b8712f73, State: Running, Role: LEADER
I20260811 11:49:15.035480 11720 consensus_queue.cc:237] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "651ea898404d4421b8fe5515b8712f73" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 42263 } }
I20260811 11:49:15.036094 11712 sys_catalog.cc:564] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:15.037479 11721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "651ea898404d4421b8fe5515b8712f73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "651ea898404d4421b8fe5515b8712f73" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 42263 } } }
I20260811 11:49:15.037647 11721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:15.037940 11722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 651ea898404d4421b8fe5515b8712f73. Latest consensus state: current_term: 1 leader_uuid: "651ea898404d4421b8fe5515b8712f73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "651ea898404d4421b8fe5515b8712f73" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 42263 } } }
I20260811 11:49:15.038081 11722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:15.038060 11731 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:15.042184 11731 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:15.048318 11731 catalog_manager.cc:1347] Generated new cluster ID: f8311c25075f46a0bbe9c23f9e2f8534
I20260811 11:49:15.048393 11731 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:15.072779 11731 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:15.074074 11731 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:15.082971 11731 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73: Generated new TSK 0
I20260811 11:49:15.083691 11731 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:49:15.094655 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:42263
--builtin_ntp_servers=127.20.244.84:44621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 11:49:15.210335 11744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:15.210619 11744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:15.210659 11744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:15.214814 11744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:15.214898 11744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:15.214955 11744 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:49:15.219964 11744 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:44621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:42263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11744
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:15.221175 11744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:15.222622 11744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:49:15.232528 11744 server_base.cc:1034] running on GCE node
W20260811 11:49:15.232457 11750 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:15.232443 11753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:15.232472 11751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:15.233152 11744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:15.233841 11744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:15.235044 11744 hybrid_clock.cc:648] HybridClock initialized: now 1786448955235023 us; error 33 us; skew 500 ppm
I20260811 11:49:15.237468 11744 webserver.cc:460] Webserver started at http://127.20.244.65:43349/ using document root <none> and password file <none>
I20260811 11:49:15.238175 11744 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:15.238286 11744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:15.238545 11744 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:15.240923 11744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "7bcb5743571c4b948265b90cf0bacb97"
format_stamp: "Formatted at 2026-08-11 11:49:15 on dist-test-slave-vkjp"
server_key: "70d34d9d3584009921a5d5b714e124bf"
server_key_iv: "e411954b907af550451db8fa33bf7a67"
server_key_version: "encryptionkey@0"
I20260811 11:49:15.241608 11744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "7bcb5743571c4b948265b90cf0bacb97"
format_stamp: "Formatted at 2026-08-11 11:49:15 on dist-test-slave-vkjp"
server_key: "70d34d9d3584009921a5d5b714e124bf"
server_key_iv: "e411954b907af550451db8fa33bf7a67"
server_key_version: "encryptionkey@0"
I20260811 11:49:15.245771 11744 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 11:49:15.248370 11761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:15.249696 11744 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 11:49:15.249851 11744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "7bcb5743571c4b948265b90cf0bacb97"
format_stamp: "Formatted at 2026-08-11 11:49:15 on dist-test-slave-vkjp"
server_key: "70d34d9d3584009921a5d5b714e124bf"
server_key_iv: "e411954b907af550451db8fa33bf7a67"
server_key_version: "encryptionkey@0"
I20260811 11:49:15.249975 11744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:15.271350 11744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:15.272156 11744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:15.272392 11744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:15.273083 11744 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:49:15.274145 11744 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:49:15.274225 11744 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:15.274307 11744 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:49:15.274366 11744 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:15.284744 11744 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:34935
I20260811 11:49:15.284798 11890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:34935 every 8 connection(s)
I20260811 11:49:15.285784 11744 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:49:15.292526 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 11744
I20260811 11:49:15.292673 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:49:15.293030 21457 external_mini_cluster.cc:1428] Setting key 5af967b71fae2ab30b8fff9d3ecb0e95
I20260811 11:49:15.295346 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:42263
--builtin_ntp_servers=127.20.244.84:44621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 11:49:15.296137 11717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:15.287923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:57667 (local address 127.20.244.126:42263)
0811 11:49:15.288150 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:15.288154 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:15.289202 (+ 1048us) server_negotiation.cc:407] Connection header received
0811 11:49:15.290665 (+ 1463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:15.290668 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:15.290721 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:15.290815 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:15.291770 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.292433 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.293904 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.294203 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.294321 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:15.295674 (+ 1353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:15.295677 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:15.295679 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:15.295692 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:15.295713 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:15.295721 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:15.295784 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:15.295972 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 11:49:15.296025 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138}
I20260811 11:49:15.297382 11893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:15.288356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:42263 (local address 127.20.244.65:57667)
0811 11:49:15.289042 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:15.289084 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:15.290370 (+ 1286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:15.290981 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:15.290989 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:15.291075 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:15.291612 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:15.291625 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.292581 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.292587 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:15.293789 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:15.293799 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.294382 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.294387 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:15.294607 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:15.295348 (+ 741us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:49:15.295350 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:15.295406 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:49:15.295508 (+ 102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:15.295809 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:15.295821 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:15.295830 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 11:49:15.295966 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 11:49:15.296285 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":136,"threads_started":1}
I20260811 11:49:15.298784 11891 heartbeater.cc:347] Connected to a master server at 127.20.244.126:42263
I20260811 11:49:15.299029 11891 heartbeater.cc:464] Registering TS with master...
I20260811 11:49:15.299587 11891 heartbeater.cc:511] Master 127.20.244.126:42263 requested a full tablet report, sending...
I20260811 11:49:15.301167 11670 ts_manager.cc:194] Registered new tserver with Master: 7bcb5743571c4b948265b90cf0bacb97 (127.20.244.65:34935)
I20260811 11:49:15.302307 11670 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.244.65:57667
W20260811 11:49:15.415745 11895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:15.416087 11895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:15.416162 11895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:15.420377 11895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:15.420475 11895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:15.420574 11895 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:49:15.425598 11895 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:44621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:42263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11895
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:15.426815 11895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:15.428335 11895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:15.438679 11901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:15.438707 11903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:15.438795 11895 server_base.cc:1034] running on GCE node
W20260811 11:49:15.438966 11900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:15.439426 11895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:15.440104 11895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:15.441299 11895 hybrid_clock.cc:648] HybridClock initialized: now 1786448955441286 us; error 27 us; skew 500 ppm
I20260811 11:49:15.443434 11895 webserver.cc:460] Webserver started at http://127.20.244.66:44213/ using document root <none> and password file <none>
I20260811 11:49:15.444037 11895 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:15.444101 11895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:15.444350 11895 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:15.446470 11895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "3cd991de4a18442885b8a875145eff47"
format_stamp: "Formatted at 2026-08-11 11:49:15 on dist-test-slave-vkjp"
server_key: "0a96b6546b454e21198c68b7ed3f7062"
server_key_iv: "13c283b0ed73b47977d20fe877d7d74a"
server_key_version: "encryptionkey@0"
I20260811 11:49:15.447149 11895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "3cd991de4a18442885b8a875145eff47"
format_stamp: "Formatted at 2026-08-11 11:49:15 on dist-test-slave-vkjp"
server_key: "0a96b6546b454e21198c68b7ed3f7062"
server_key_iv: "13c283b0ed73b47977d20fe877d7d74a"
server_key_version: "encryptionkey@0"
I20260811 11:49:15.450911 11895 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 11:49:15.453490 11909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:15.454936 11895 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 11:49:15.455068 11895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "3cd991de4a18442885b8a875145eff47"
format_stamp: "Formatted at 2026-08-11 11:49:15 on dist-test-slave-vkjp"
server_key: "0a96b6546b454e21198c68b7ed3f7062"
server_key_iv: "13c283b0ed73b47977d20fe877d7d74a"
server_key_version: "encryptionkey@0"
I20260811 11:49:15.455231 11895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:15.473196 11895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:15.473852 11895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:15.474012 11895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:15.474555 11895 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:49:15.475555 11895 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:49:15.475603 11895 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:15.475643 11895 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:49:15.475658 11895 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:15.484935 11895 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:38351
I20260811 11:49:15.484956 12038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:38351 every 8 connection(s)
I20260811 11:49:15.485908 11895 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:49:15.493775 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 11895
I20260811 11:49:15.493920 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:49:15.494279 21457 external_mini_cluster.cc:1428] Setting key 20bc9c7e416f640b33a6429dc7155a48
I20260811 11:49:15.495458 11717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:15.487847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:47287 (local address 127.20.244.126:42263)
0811 11:49:15.488025 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:15.488030 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:15.489101 (+ 1071us) server_negotiation.cc:407] Connection header received
0811 11:49:15.490467 (+ 1366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:15.490470 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:15.490518 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:15.490598 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:15.491510 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.492037 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.493198 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.493447 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.493533 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:15.494911 (+ 1378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:15.494917 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:15.494925 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:15.494938 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:15.494959 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:15.494967 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:15.495056 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:15.495250 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 11:49:15.495314 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 11:49:15.496567 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:42263
--builtin_ntp_servers=127.20.244.84:44621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 11:49:15.496599 12041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:15.488302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:42263 (local address 127.20.244.66:47287)
0811 11:49:15.488942 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:15.488985 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:15.490269 (+ 1284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:15.490766 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:15.490773 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:15.490854 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:15.491374 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:15.491387 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.492149 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.492151 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:15.493053 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:15.493062 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.493611 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.493615 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:15.493827 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:15.494597 (+ 770us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:49:15.494599 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:15.494651 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:49:15.494744 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:15.495058 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:15.495071 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:15.495099 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 11:49:15.495249 (+ 150us) client_negotiation.cc:240] Negotiation successful
0811 11:49:15.495548 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":113,"threads_started":1}
I20260811 11:49:15.497764 12039 heartbeater.cc:347] Connected to a master server at 127.20.244.126:42263
I20260811 11:49:15.498008 12039 heartbeater.cc:464] Registering TS with master...
I20260811 11:49:15.498644 12039 heartbeater.cc:511] Master 127.20.244.126:42263 requested a full tablet report, sending...
I20260811 11:49:15.499846 11670 ts_manager.cc:194] Registered new tserver with Master: 3cd991de4a18442885b8a875145eff47 (127.20.244.66:38351)
I20260811 11:49:15.500520 11670 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.244.66:47287
W20260811 11:49:15.617892 12042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:15.618181 12042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:15.618221 12042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:15.622311 12042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:15.622377 12042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:15.622471 12042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:49:15.627445 12042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:44621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:42263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12042
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:15.628610 12042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:15.630041 12042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:15.640391 12049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:15.640403 12052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:15.640457 12047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:15.640621 12042 server_base.cc:1034] running on GCE node
I20260811 11:49:15.641211 12042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:15.641921 12042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:15.643162 12042 hybrid_clock.cc:648] HybridClock initialized: now 1786448955643136 us; error 32 us; skew 500 ppm
I20260811 11:49:15.645262 12042 webserver.cc:460] Webserver started at http://127.20.244.67:46195/ using document root <none> and password file <none>
I20260811 11:49:15.645871 12042 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:15.645936 12042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:15.646206 12042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:15.648495 12042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "eedbdf19501c4e3c951727c07b46ea3e"
format_stamp: "Formatted at 2026-08-11 11:49:15 on dist-test-slave-vkjp"
server_key: "59ee1a74653e4ce8da8df4249482d3f3"
server_key_iv: "1262eb1e7e4095402a6eb5a013eb7bf7"
server_key_version: "encryptionkey@0"
I20260811 11:49:15.649137 12042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "eedbdf19501c4e3c951727c07b46ea3e"
format_stamp: "Formatted at 2026-08-11 11:49:15 on dist-test-slave-vkjp"
server_key: "59ee1a74653e4ce8da8df4249482d3f3"
server_key_iv: "1262eb1e7e4095402a6eb5a013eb7bf7"
server_key_version: "encryptionkey@0"
I20260811 11:49:15.653261 12042 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 11:49:15.656260 12059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:15.657832 12042 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:49:15.657999 12042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "eedbdf19501c4e3c951727c07b46ea3e"
format_stamp: "Formatted at 2026-08-11 11:49:15 on dist-test-slave-vkjp"
server_key: "59ee1a74653e4ce8da8df4249482d3f3"
server_key_iv: "1262eb1e7e4095402a6eb5a013eb7bf7"
server_key_version: "encryptionkey@0"
I20260811 11:49:15.658175 12042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:15.669829 12042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:15.670620 12042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:15.670828 12042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:15.671530 12042 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:49:15.672524 12042 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:49:15.672572 12042 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:15.672643 12042 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:49:15.672678 12042 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:15.681782 12042 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:46273
I20260811 11:49:15.681849 12187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:46273 every 8 connection(s)
I20260811 11:49:15.682758 12042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:49:15.684732 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 12042
I20260811 11:49:15.684856 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:49:15.685146 21457 external_mini_cluster.cc:1428] Setting key 73c4305e4f1466c2f0a7de0ebea8f9d9
I20260811 11:49:15.692518 11717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:15.684692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:42737 (local address 127.20.244.126:42263)
0811 11:49:15.684856 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:15.684861 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:15.686150 (+ 1289us) server_negotiation.cc:407] Connection header received
0811 11:49:15.687895 (+ 1745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:15.687897 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:15.687945 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:15.688019 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:15.688875 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.689394 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.690515 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.690746 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.690827 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:15.692091 (+ 1264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:15.692094 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:15.692096 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:15.692108 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:15.692129 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:15.692137 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:15.692199 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:15.692340 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 11:49:15.692391 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 11:49:15.693370 12190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:15.685167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:42263 (local address 127.20.244.67:42737)
0811 11:49:15.686000 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:15.686059 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:15.687700 (+ 1641us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:15.688184 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:15.688190 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:15.688272 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:15.688755 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:15.688767 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.689505 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.689507 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:15.690390 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:15.690399 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.690889 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.690892 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:15.691046 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:15.691840 (+ 794us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:49:15.691841 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:15.691882 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:49:15.691951 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:15.692218 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:15.692224 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:15.692228 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:49:15.692322 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 11:49:15.692544 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":155,"threads_started":1}
I20260811 11:49:15.694476 12188 heartbeater.cc:347] Connected to a master server at 127.20.244.126:42263
I20260811 11:49:15.694698 12188 heartbeater.cc:464] Registering TS with master...
I20260811 11:49:15.695255 12188 heartbeater.cc:511] Master 127.20.244.126:42263 requested a full tablet report, sending...
I20260811 11:49:15.696270 11670 ts_manager.cc:194] Registered new tserver with Master: eedbdf19501c4e3c951727c07b46ea3e (127.20.244.67:46273)
I20260811 11:49:15.696861 11670 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.244.67:42737
I20260811 11:49:15.699296 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:49:15.704975 11717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:15.701211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55270 (local address 127.20.244.126:42263)
0811 11:49:15.701364 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:15.701369 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:15.701593 (+ 224us) server_negotiation.cc:407] Connection header received
0811 11:49:15.701683 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:15.701685 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:15.701725 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:15.701788 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:15.702000 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.702505 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.703347 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.703569 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.703649 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:15.704490 (+ 841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:15.704493 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:15.704495 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:15.704506 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:15.704525 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:15.704533 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:15.704632 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:15.704751 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 11:49:15.704807 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 11:49:15.707999 11670 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55270:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:49:15.711202 11670 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:49:15.727231 12200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:15.720747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52348 (local address 127.20.244.67:46273)
0811 11:49:15.722171 (+ 1424us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:15.722182 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:15.722202 (+ 20us) server_negotiation.cc:407] Connection header received
0811 11:49:15.722266 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:15.722270 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:15.722410 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:15.722880 (+ 470us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:15.722983 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.724174 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.725653 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.726387 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.726493 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:15.726701 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:15.726892 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 11:49:15.727010 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1328,"thread_start_us":174,"threads_started":1}
I20260811 11:49:15.727228 12199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:15.720587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:38351 (local address 127.0.0.1:48358)
0811 11:49:15.721091 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:15.721146 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:15.721273 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:15.722899 (+ 1626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:15.722902 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:15.722920 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:15.723000 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:15.723005 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.724386 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.724391 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:15.725857 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:15.725865 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.726704 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.726707 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:15.726809 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:15.726881 (+ 72us) client_negotiation.cc:769] Sending connection context
0811 11:49:15.726936 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 11:49:15.727027 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"mutex_wait_us":128,"thread_start_us":119,"threads_started":1}
I20260811 11:49:15.727609 12202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:15.721459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:34935 (local address 127.0.0.1:60910)
0811 11:49:15.721717 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:15.721730 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:15.721850 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:15.722578 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:15.722584 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:15.722619 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:15.722757 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:15.722763 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.723960 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.723965 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:15.725353 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:15.725364 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.726785 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.726788 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:15.726944 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:15.726968 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 11:49:15.727041 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 11:49:15.727149 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":37,"spinlock_wait_cycles":3328,"thread_start_us":92,"threads_started":1}
I20260811 11:49:15.727228 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:15.720587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:46273 (local address 127.0.0.1:52348)
0811 11:49:15.721426 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:15.721440 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:15.721534 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:15.722580 (+ 1046us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:15.722590 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:15.722621 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:15.722756 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:15.722762 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.724323 (+ 1561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.724328 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:15.725523 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:15.725534 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.726522 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.726528 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:15.726671 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:15.726724 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 11:49:15.726841 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 11:49:15.727034 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":773,"mutex_wait_us":617,"spinlock_wait_cycles":4352,"thread_start_us":101,"threads_started":1}
I20260811 11:49:15.728101 12204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:15.721795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60910 (local address 127.20.244.65:34935)
0811 11:49:15.722168 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:15.722181 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:15.722201 (+ 20us) server_negotiation.cc:407] Connection header received
0811 11:49:15.722265 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:15.722268 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:15.722410 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:15.722573 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:15.722885 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.723823 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.725486 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.726370 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.726493 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:15.726701 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:15.727783 (+ 1082us) server_negotiation.cc:299] Negotiation successful
0811 11:49:15.727908 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":176,"threads_started":1}
I20260811 11:49:15.728327 12203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:15.721697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48358 (local address 127.20.244.66:38351)
0811 11:49:15.722044 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:15.722057 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:15.722084 (+ 27us) server_negotiation.cc:407] Connection header received
0811 11:49:15.722167 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:15.722172 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:15.722386 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:15.722561 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:15.723131 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.724273 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.725973 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:15.726566 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:15.727638 (+ 1072us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:15.727971 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:15.728027 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 11:49:15.728131 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":139,"threads_started":1}
I20260811 11:49:15.730955 11963 tablet_service.cc:1467] Processing CreateTablet for tablet 28c56320b2ad480cbc2cac402b9cde6b (DEFAULT_TABLE table=test-table [id=243ec2affdf749ff8c69beb6f89e6f2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:49:15.731071 11814 tablet_service.cc:1467] Processing CreateTablet for tablet 28c56320b2ad480cbc2cac402b9cde6b (DEFAULT_TABLE table=test-table [id=243ec2affdf749ff8c69beb6f89e6f2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:49:15.731071 12112 tablet_service.cc:1467] Processing CreateTablet for tablet 28c56320b2ad480cbc2cac402b9cde6b (DEFAULT_TABLE table=test-table [id=243ec2affdf749ff8c69beb6f89e6f2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:49:15.732177 11963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28c56320b2ad480cbc2cac402b9cde6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:15.732180 11814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28c56320b2ad480cbc2cac402b9cde6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:15.732180 12112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28c56320b2ad480cbc2cac402b9cde6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:15.739498 12205 tablet_bootstrap.cc:492] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47: Bootstrap starting.
I20260811 11:49:15.740255 12208 tablet_bootstrap.cc:492] T 28c56320b2ad480cbc2cac402b9cde6b P eedbdf19501c4e3c951727c07b46ea3e: Bootstrap starting.
I20260811 11:49:15.740453 12207 tablet_bootstrap.cc:492] T 28c56320b2ad480cbc2cac402b9cde6b P 7bcb5743571c4b948265b90cf0bacb97: Bootstrap starting.
I20260811 11:49:15.742071 12205 tablet_bootstrap.cc:654] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:15.742509 12208 tablet_bootstrap.cc:654] T 28c56320b2ad480cbc2cac402b9cde6b P eedbdf19501c4e3c951727c07b46ea3e: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:15.742511 12207 tablet_bootstrap.cc:654] T 28c56320b2ad480cbc2cac402b9cde6b P 7bcb5743571c4b948265b90cf0bacb97: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:15.742937 12205 log.cc:824] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:15.743386 12207 log.cc:824] T 28c56320b2ad480cbc2cac402b9cde6b P 7bcb5743571c4b948265b90cf0bacb97: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:15.743386 12208 log.cc:824] T 28c56320b2ad480cbc2cac402b9cde6b P eedbdf19501c4e3c951727c07b46ea3e: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:15.745471 12208 tablet_bootstrap.cc:492] T 28c56320b2ad480cbc2cac402b9cde6b P eedbdf19501c4e3c951727c07b46ea3e: No bootstrap required, opened a new log
I20260811 11:49:15.745590 12207 tablet_bootstrap.cc:492] T 28c56320b2ad480cbc2cac402b9cde6b P 7bcb5743571c4b948265b90cf0bacb97: No bootstrap required, opened a new log
I20260811 11:49:15.745590 12205 tablet_bootstrap.cc:492] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47: No bootstrap required, opened a new log
I20260811 11:49:15.745633 12208 ts_tablet_manager.cc:1397] T 28c56320b2ad480cbc2cac402b9cde6b P eedbdf19501c4e3c951727c07b46ea3e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 11:49:15.745770 12207 ts_tablet_manager.cc:1397] T 28c56320b2ad480cbc2cac402b9cde6b P 7bcb5743571c4b948265b90cf0bacb97: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 11:49:15.745770 12205 ts_tablet_manager.cc:1397] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260811 11:49:15.749251 12208 raft_consensus.cc:348] T 28c56320b2ad480cbc2cac402b9cde6b P eedbdf19501c4e3c951727c07b46ea3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eedbdf19501c4e3c951727c07b46ea3e" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 46273 } } peers { permanent_uuid: "3cd991de4a18442885b8a875145eff47" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38351 } } peers { permanent_uuid: "7bcb5743571c4b948265b90cf0bacb97" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34935 } }
I20260811 11:49:15.749524 12208 raft_consensus.cc:374] T 28c56320b2ad480cbc2cac402b9cde6b P eedbdf19501c4e3c951727c07b46ea3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:15.749580 12208 raft_consensus.cc:729] T 28c56320b2ad480cbc2cac402b9cde6b P eedbdf19501c4e3c951727c07b46ea3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eedbdf19501c4e3c951727c07b46ea3e, State: Initialized, Role: FOLLOWER
I20260811 11:49:15.750000 12208 consensus_queue.cc:260] T 28c56320b2ad480cbc2cac402b9cde6b P eedbdf19501c4e3c951727c07b46ea3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eedbdf19501c4e3c951727c07b46ea3e" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 46273 } } peers { permanent_uuid: "3cd991de4a18442885b8a875145eff47" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38351 } } peers { permanent_uuid: "7bcb5743571c4b948265b90cf0bacb97" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34935 } }
I20260811 11:49:15.750105 12205 raft_consensus.cc:348] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eedbdf19501c4e3c951727c07b46ea3e" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 46273 } } peers { permanent_uuid: "3cd991de4a18442885b8a875145eff47" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38351 } } peers { permanent_uuid: "7bcb5743571c4b948265b90cf0bacb97" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34935 } }
I20260811 11:49:15.750085 12207 raft_consensus.cc:348] T 28c56320b2ad480cbc2cac402b9cde6b P 7bcb5743571c4b948265b90cf0bacb97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eedbdf19501c4e3c951727c07b46ea3e" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 46273 } } peers { permanent_uuid: "3cd991de4a18442885b8a875145eff47" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38351 } } peers { permanent_uuid: "7bcb5743571c4b948265b90cf0bacb97" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34935 } }
I20260811 11:49:15.750356 12207 raft_consensus.cc:374] T 28c56320b2ad480cbc2cac402b9cde6b P 7bcb5743571c4b948265b90cf0bacb97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:15.750356 12205 raft_consensus.cc:374] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:15.750417 12207 raft_consensus.cc:729] T 28c56320b2ad480cbc2cac402b9cde6b P 7bcb5743571c4b948265b90cf0bacb97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bcb5743571c4b948265b90cf0bacb97, State: Initialized, Role: FOLLOWER
I20260811 11:49:15.750425 12205 raft_consensus.cc:729] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cd991de4a18442885b8a875145eff47, State: Initialized, Role: FOLLOWER
I20260811 11:49:15.750880 12188 heartbeater.cc:503] Master 127.20.244.126:42263 was elected leader, sending a full tablet report...
I20260811 11:49:15.750921 12207 consensus_queue.cc:260] T 28c56320b2ad480cbc2cac402b9cde6b P 7bcb5743571c4b948265b90cf0bacb97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eedbdf19501c4e3c951727c07b46ea3e" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 46273 } } peers { permanent_uuid: "3cd991de4a18442885b8a875145eff47" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38351 } } peers { permanent_uuid: "7bcb5743571c4b948265b90cf0bacb97" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34935 } }
I20260811 11:49:15.751020 12205 consensus_queue.cc:260] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eedbdf19501c4e3c951727c07b46ea3e" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 46273 } } peers { permanent_uuid: "3cd991de4a18442885b8a875145eff47" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38351 } } peers { permanent_uuid: "7bcb5743571c4b948265b90cf0bacb97" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34935 } }
I20260811 11:49:15.751161 12208 ts_tablet_manager.cc:1428] T 28c56320b2ad480cbc2cac402b9cde6b P eedbdf19501c4e3c951727c07b46ea3e: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260811 11:49:15.751931 12207 ts_tablet_manager.cc:1428] T 28c56320b2ad480cbc2cac402b9cde6b P 7bcb5743571c4b948265b90cf0bacb97: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 11:49:15.751931 12205 ts_tablet_manager.cc:1428] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 11:49:15.752276 12039 heartbeater.cc:503] Master 127.20.244.126:42263 was elected leader, sending a full tablet report...
I20260811 11:49:15.752838 11891 heartbeater.cc:503] Master 127.20.244.126:42263 was elected leader, sending a full tablet report...
W20260811 11:49:15.787110 11892 tablet.cc:2369] T 28c56320b2ad480cbc2cac402b9cde6b P 7bcb5743571c4b948265b90cf0bacb97: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:49:15.933905 12189 tablet.cc:2369] T 28c56320b2ad480cbc2cac402b9cde6b P eedbdf19501c4e3c951727c07b46ea3e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:49:15.987304 12040 tablet.cc:2369] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:49:16.046002 12215 raft_consensus.cc:482] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:49:16.046346 12215 raft_consensus.cc:504] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eedbdf19501c4e3c951727c07b46ea3e" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 46273 } } peers { permanent_uuid: "3cd991de4a18442885b8a875145eff47" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38351 } } peers { permanent_uuid: "7bcb5743571c4b948265b90cf0bacb97" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34935 } }
I20260811 11:49:16.047691 12215 leader_election.cc:288] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eedbdf19501c4e3c951727c07b46ea3e (127.20.244.67:46273), 7bcb5743571c4b948265b90cf0bacb97 (127.20.244.65:34935)
I20260811 11:49:16.052145 12204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:16.048244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:48337 (local address 127.20.244.65:34935)
0811 11:49:16.048407 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:16.048412 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:16.048610 (+ 198us) server_negotiation.cc:407] Connection header received
0811 11:49:16.048785 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:16.048788 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:16.048868 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:16.048950 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:16.049305 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:16.049805 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:16.051042 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:16.051504 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:16.051636 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:16.051690 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:16.051940 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 11:49:16.052015 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 11:49:16.052152 12200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:16.048150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:49839 (local address 127.20.244.67:46273)
0811 11:49:16.048318 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:16.048325 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:16.048558 (+ 233us) server_negotiation.cc:407] Connection header received
0811 11:49:16.048720 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:16.048726 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:16.048788 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:16.048865 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:16.049228 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:16.049819 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:16.050947 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:16.051509 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:16.051653 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:16.051706 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:16.051966 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 11:49:16.052038 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 11:49:16.052165 12217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:16.048014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:46273 (local address 127.20.244.66:49839)
0811 11:49:16.048437 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:16.048454 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:16.048590 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:16.048904 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:16.048910 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:16.048933 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:16.049085 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:16.049092 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:16.049967 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:16.049970 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:16.050813 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:16.050822 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:16.051653 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:16.051656 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:16.051809 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:16.051835 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 11:49:16.051932 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 11:49:16.052005 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":75,"thread_start_us":108,"threads_started":1}
I20260811 11:49:16.052175 12216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:16.048014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:34935 (local address 127.20.244.66:48337)
0811 11:49:16.048477 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:16.048490 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:16.048667 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:16.048985 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:16.048989 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:16.049006 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:16.049126 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:16.049180 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:16.049929 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:16.049933 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:16.050910 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:16.050925 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:16.051635 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:16.051639 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:16.051789 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:16.051823 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 11:49:16.051890 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 11:49:16.051991 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"mutex_wait_us":80,"thread_start_us":87,"threads_started":1}
I20260811 11:49:16.052929 12134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28c56320b2ad480cbc2cac402b9cde6b" candidate_uuid: "3cd991de4a18442885b8a875145eff47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eedbdf19501c4e3c951727c07b46ea3e" is_pre_election: true
I20260811 11:49:16.053020 11839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28c56320b2ad480cbc2cac402b9cde6b" candidate_uuid: "3cd991de4a18442885b8a875145eff47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bcb5743571c4b948265b90cf0bacb97" is_pre_election: true
I20260811 11:49:16.053288 12134 raft_consensus.cc:2454] T 28c56320b2ad480cbc2cac402b9cde6b P eedbdf19501c4e3c951727c07b46ea3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cd991de4a18442885b8a875145eff47 in term 0.
I20260811 11:49:16.053288 11839 raft_consensus.cc:2454] T 28c56320b2ad480cbc2cac402b9cde6b P 7bcb5743571c4b948265b90cf0bacb97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cd991de4a18442885b8a875145eff47 in term 0.
I20260811 11:49:16.053874 11911 leader_election.cc:302] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3cd991de4a18442885b8a875145eff47, 7bcb5743571c4b948265b90cf0bacb97, eedbdf19501c4e3c951727c07b46ea3e; no voters:
I20260811 11:49:16.054157 12215 raft_consensus.cc:2781] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:49:16.054250 12215 raft_consensus.cc:482] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:49:16.054307 12215 raft_consensus.cc:3037] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:16.055518 12215 raft_consensus.cc:504] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eedbdf19501c4e3c951727c07b46ea3e" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 46273 } } peers { permanent_uuid: "3cd991de4a18442885b8a875145eff47" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38351 } } peers { permanent_uuid: "7bcb5743571c4b948265b90cf0bacb97" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34935 } }
I20260811 11:49:16.055927 12215 leader_election.cc:288] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47 [CANDIDATE]: Term 1 election: Requested vote from peers eedbdf19501c4e3c951727c07b46ea3e (127.20.244.67:46273), 7bcb5743571c4b948265b90cf0bacb97 (127.20.244.65:34935)
I20260811 11:49:16.056303 12134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28c56320b2ad480cbc2cac402b9cde6b" candidate_uuid: "3cd991de4a18442885b8a875145eff47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eedbdf19501c4e3c951727c07b46ea3e"
I20260811 11:49:16.056474 12134 raft_consensus.cc:3037] T 28c56320b2ad480cbc2cac402b9cde6b P eedbdf19501c4e3c951727c07b46ea3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:16.056396 11839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28c56320b2ad480cbc2cac402b9cde6b" candidate_uuid: "3cd991de4a18442885b8a875145eff47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bcb5743571c4b948265b90cf0bacb97"
I20260811 11:49:16.056617 11839 raft_consensus.cc:3037] T 28c56320b2ad480cbc2cac402b9cde6b P 7bcb5743571c4b948265b90cf0bacb97 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:16.058252 11839 raft_consensus.cc:2454] T 28c56320b2ad480cbc2cac402b9cde6b P 7bcb5743571c4b948265b90cf0bacb97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cd991de4a18442885b8a875145eff47 in term 1.
I20260811 11:49:16.058295 12134 raft_consensus.cc:2454] T 28c56320b2ad480cbc2cac402b9cde6b P eedbdf19501c4e3c951727c07b46ea3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cd991de4a18442885b8a875145eff47 in term 1.
I20260811 11:49:16.058775 11913 leader_election.cc:302] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cd991de4a18442885b8a875145eff47, 7bcb5743571c4b948265b90cf0bacb97; no voters:
I20260811 11:49:16.058993 12215 raft_consensus.cc:2781] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:16.059373 12215 raft_consensus.cc:686] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47 [term 1 LEADER]: Becoming Leader. State: Replica: 3cd991de4a18442885b8a875145eff47, State: Running, Role: LEADER
I20260811 11:49:16.059753 12215 consensus_queue.cc:237] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eedbdf19501c4e3c951727c07b46ea3e" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 46273 } } peers { permanent_uuid: "3cd991de4a18442885b8a875145eff47" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38351 } } peers { permanent_uuid: "7bcb5743571c4b948265b90cf0bacb97" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34935 } }
I20260811 11:49:16.063578 11670 catalog_manager.cc:5495] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cd991de4a18442885b8a875145eff47 (127.20.244.66). New cstate: current_term: 1 leader_uuid: "3cd991de4a18442885b8a875145eff47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eedbdf19501c4e3c951727c07b46ea3e" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 46273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cd991de4a18442885b8a875145eff47" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7bcb5743571c4b948265b90cf0bacb97" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34935 } health_report { overall_health: UNKNOWN } } }
I20260811 11:49:16.094946 12203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:16.091453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48360 (local address 127.20.244.66:38351)
0811 11:49:16.091594 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:16.091597 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:16.091612 (+ 15us) server_negotiation.cc:407] Connection header received
0811 11:49:16.091684 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:16.091686 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:16.091742 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:16.091836 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:49:16.092064 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:16.092549 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:16.093375 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:16.093585 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:16.093664 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:16.094055 (+ 391us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:49:16.094457 (+ 402us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:49:16.094569 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:16.094721 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 11:49:16.094781 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 11:49:16.101195 12134 raft_consensus.cc:1261] T 28c56320b2ad480cbc2cac402b9cde6b P eedbdf19501c4e3c951727c07b46ea3e [term 1 FOLLOWER]: Refusing update from remote peer 3cd991de4a18442885b8a875145eff47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:49:16.101207 11839 raft_consensus.cc:1261] T 28c56320b2ad480cbc2cac402b9cde6b P 7bcb5743571c4b948265b90cf0bacb97 [term 1 FOLLOWER]: Refusing update from remote peer 3cd991de4a18442885b8a875145eff47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:49:16.101930 12218 consensus_queue.cc:1035] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eedbdf19501c4e3c951727c07b46ea3e" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 46273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:49:16.102144 12215 consensus_queue.cc:1035] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bcb5743571c4b948265b90cf0bacb97" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:49:16.109975 12222 mvcc.cc:205] Tried to move back new op lower bound from 7317294924182097920 to 7317294924023906304. Current Snapshot: MvccSnapshot[applied={T|T < 7317294924182097920}]
I20260811 11:49:16.110217 12224 mvcc.cc:205] Tried to move back new op lower bound from 7317294924182097920 to 7317294924023906304. Current Snapshot: MvccSnapshot[applied={T|T < 7317294924182097920}]
I20260811 11:49:16.112193 12223 mvcc.cc:205] Tried to move back new op lower bound from 7317294924182097920 to 7317294924023906304. Current Snapshot: MvccSnapshot[applied={T|T < 7317294924182097920}]
I20260811 11:49:16.119707 11670 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:49:16.119899 11670 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:49:16.122746 11670 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 651ea898404d4421b8fe5515b8712f73: Sending DeleteTablet for 3 replicas of tablet 28c56320b2ad480cbc2cac402b9cde6b
I20260811 11:49:16.123711 12112 tablet_service.cc:1514] Processing DeleteTablet for tablet 28c56320b2ad480cbc2cac402b9cde6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:49:16 UTC) from {username='slave'} at 127.0.0.1:52348
I20260811 11:49:16.123768 11814 tablet_service.cc:1514] Processing DeleteTablet for tablet 28c56320b2ad480cbc2cac402b9cde6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:49:16 UTC) from {username='slave'} at 127.0.0.1:60910
I20260811 11:49:16.123983 11963 tablet_service.cc:1514] Processing DeleteTablet for tablet 28c56320b2ad480cbc2cac402b9cde6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:49:16 UTC) from {username='slave'} at 127.0.0.1:48358
I20260811 11:49:16.124366 12232 tablet_replica.cc:330] T 28c56320b2ad480cbc2cac402b9cde6b P eedbdf19501c4e3c951727c07b46ea3e: stopping tablet replica
I20260811 11:49:16.124711 12232 raft_consensus.cc:2229] T 28c56320b2ad480cbc2cac402b9cde6b P eedbdf19501c4e3c951727c07b46ea3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:49:16.125017 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 11744
I20260811 11:49:16.125051 12232 raft_consensus.cc:2258] T 28c56320b2ad480cbc2cac402b9cde6b P eedbdf19501c4e3c951727c07b46ea3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:49:16.127630 12234 tablet_replica.cc:330] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47: stopping tablet replica
I20260811 11:49:16.128036 12234 raft_consensus.cc:2229] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:49:16.128590 12234 raft_consensus.cc:2258] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:49:16.132364 12232 ts_tablet_manager.cc:1905] T 28c56320b2ad480cbc2cac402b9cde6b P eedbdf19501c4e3c951727c07b46ea3e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:49:16.136700 12232 ts_tablet_manager.cc:1918] T 28c56320b2ad480cbc2cac402b9cde6b P eedbdf19501c4e3c951727c07b46ea3e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:49:16.136889 12232 log.cc:1196] T 28c56320b2ad480cbc2cac402b9cde6b P eedbdf19501c4e3c951727c07b46ea3e: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/28c56320b2ad480cbc2cac402b9cde6b
I20260811 11:49:16.137395 12232 ts_tablet_manager.cc:1939] T 28c56320b2ad480cbc2cac402b9cde6b P eedbdf19501c4e3c951727c07b46ea3e: Deleting consensus metadata
I20260811 11:49:16.139638 11652 catalog_manager.cc:4841] TS eedbdf19501c4e3c951727c07b46ea3e (127.20.244.67:46273): tablet 28c56320b2ad480cbc2cac402b9cde6b (table test-table [id=243ec2affdf749ff8c69beb6f89e6f2f]) successfully deleted
I20260811 11:49:16.139773 12234 ts_tablet_manager.cc:1905] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:49:16.143301 12234 ts_tablet_manager.cc:1918] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:49:16.143424 12234 log.cc:1196] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/28c56320b2ad480cbc2cac402b9cde6b
I20260811 11:49:16.143756 12234 ts_tablet_manager.cc:1939] T 28c56320b2ad480cbc2cac402b9cde6b P 3cd991de4a18442885b8a875145eff47: Deleting consensus metadata
I20260811 11:49:16.145051 11653 catalog_manager.cc:4841] TS 3cd991de4a18442885b8a875145eff47 (127.20.244.66:38351): tablet 28c56320b2ad480cbc2cac402b9cde6b (table test-table [id=243ec2affdf749ff8c69beb6f89e6f2f]) successfully deleted
W20260811 11:49:16.147707 11653 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.244.65:34935 (error 108)
I20260811 11:49:16.147850 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 11895
I20260811 11:49:16.153116 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:16.152756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:34935 (local address 127.0.0.1:60918)
0811 11:49:16.152929 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:16.153017 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.65:34935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260811 11:49:16.153316 11653 catalog_manager.cc:4584] TS 7bcb5743571c4b948265b90cf0bacb97 (127.20.244.65:34935): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 28c56320b2ad480cbc2cac402b9cde6b: Network error: Client connection negotiation failed: client connection to 127.20.244.65:34935: connect: Connection refused (error 111)
I20260811 11:49:16.157889 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 12042
I20260811 11:49:16.167552 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 11632
2026-08-11T11:49:16Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1393 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:16 dist-test-slave-vkjp krb5kdc[12238](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:16 dist-test-slave-vkjp krb5kdc[12238](info): set up 2 sockets
Aug 11 11:49:16 dist-test-slave-vkjp krb5kdc[12238](info): commencing operation
krb5kdc: starting...
W20260811 11:49:17.394856 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.202s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:17 dist-test-slave-vkjp krb5kdc[12238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448957, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:49:17.530697 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:40603
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:33887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:40603
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:17.650285 12256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:17.650645 12256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:17.650738 12256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:17.654992 12256 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:17.655123 12256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:17.655175 12256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:17.655217 12256 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:17.655270 12256 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:17.660878 12256 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:33887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:40603
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:40603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:17.662070 12256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:17.663275 12256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:17.672273 12262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:17.672279 12264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:17.672508 12256 server_base.cc:1034] running on GCE node
W20260811 11:49:17.672662 12266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:17.673259 12256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:17.674474 12256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:17.675638 12256 hybrid_clock.cc:648] HybridClock initialized: now 1786448957675604 us; error 48 us; skew 500 ppm
Aug 11 11:49:17 dist-test-slave-vkjp krb5kdc[12238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448957, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:17.678514 12256 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:49:17.679527 12256 webserver.cc:460] Webserver started at http://127.20.244.126:43067/ using document root <none> and password file <none>
I20260811 11:49:17.680074 12256 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:17.680136 12256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:17.680346 12256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:17.682482 12256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "3a9bb4732dcd4e6caa88215133c40a82"
format_stamp: "Formatted at 2026-08-11 11:49:17 on dist-test-slave-vkjp"
server_key: "4ef104e9fb748487e16c1c8b05132a8b"
server_key_iv: "db4606186295a81253690814db3ecc2f"
server_key_version: "encryptionkey@0"
I20260811 11:49:17.683015 12256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "3a9bb4732dcd4e6caa88215133c40a82"
format_stamp: "Formatted at 2026-08-11 11:49:17 on dist-test-slave-vkjp"
server_key: "4ef104e9fb748487e16c1c8b05132a8b"
server_key_iv: "db4606186295a81253690814db3ecc2f"
server_key_version: "encryptionkey@0"
I20260811 11:49:17.687026 12256 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 11:49:17.689652 12273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:17.691025 12256 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 11:49:17.691206 12256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "3a9bb4732dcd4e6caa88215133c40a82"
format_stamp: "Formatted at 2026-08-11 11:49:17 on dist-test-slave-vkjp"
server_key: "4ef104e9fb748487e16c1c8b05132a8b"
server_key_iv: "db4606186295a81253690814db3ecc2f"
server_key_version: "encryptionkey@0"
I20260811 11:49:17.691313 12256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:17.717365 12256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:17.721072 12256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:17.721288 12256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:17.729388 12256 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:40603
I20260811 11:49:17.729403 12335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:40603 every 8 connection(s)
I20260811 11:49:17.730443 12256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:17.733418 12336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:17.738724 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 12256
I20260811 11:49:17.738884 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:17.739230 21457 external_mini_cluster.cc:1428] Setting key 64db2ec3d15eaeadcb4636a12f3900a1
I20260811 11:49:17.739447 12336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82: Bootstrap starting.
I20260811 11:49:17.742158 12336 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:17.742936 12336 log.cc:824] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:17.745250 12336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82: No bootstrap required, opened a new log
Aug 11 11:49:17 dist-test-slave-vkjp krb5kdc[12238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448957, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:49:17.748813 12336 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a9bb4732dcd4e6caa88215133c40a82" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40603 } }
I20260811 11:49:17.749086 12336 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:17.749166 12336 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9bb4732dcd4e6caa88215133c40a82, State: Initialized, Role: FOLLOWER
I20260811 11:49:17.749696 12336 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a9bb4732dcd4e6caa88215133c40a82" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40603 } }
I20260811 11:49:17.749876 12336 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:17.749945 12336 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:17.750056 12336 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:17.750990 12336 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a9bb4732dcd4e6caa88215133c40a82" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40603 } }
I20260811 11:49:17.751350 12336 leader_election.cc:302] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a9bb4732dcd4e6caa88215133c40a82; no voters:
I20260811 11:49:17.751689 12336 leader_election.cc:288] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:17.751768 12342 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:17.751981 12342 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82 [term 1 LEADER]: Becoming Leader. State: Replica: 3a9bb4732dcd4e6caa88215133c40a82, State: Running, Role: LEADER
I20260811 11:49:17.752278 12342 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a9bb4732dcd4e6caa88215133c40a82" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40603 } }
I20260811 11:49:17.753032 12336 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:17.754118 12344 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a9bb4732dcd4e6caa88215133c40a82. Latest consensus state: current_term: 1 leader_uuid: "3a9bb4732dcd4e6caa88215133c40a82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a9bb4732dcd4e6caa88215133c40a82" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40603 } } }
I20260811 11:49:17.754344 12344 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:17.754383 12343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a9bb4732dcd4e6caa88215133c40a82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a9bb4732dcd4e6caa88215133c40a82" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 40603 } } }
I20260811 11:49:17.754506 12343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:17.754875 12352 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:17.755076 12339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:17.740758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39138 (local address 127.20.244.126:40603)
0811 11:49:17.741266 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:17.741283 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:17.741318 (+ 35us) server_negotiation.cc:407] Connection header received
0811 11:49:17.742054 (+ 736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:17.742074 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:17.742484 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:17.742827 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:17.743740 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:17.745158 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:17.746079 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:17.746555 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:17.746725 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:17.749323 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:17.749329 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:17.749346 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:17.749379 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:17.751404 (+ 2025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:17.751918 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:17.751923 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:17.751927 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:17.752097 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:17.752413 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:17.752417 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:17.752418 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:17.752843 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:17.753068 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:17.753425 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 11:49:17.753739 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":167,"threads_started":1}
I20260811 11:49:17.758185 12352 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:17.763433 12352 catalog_manager.cc:1347] Generated new cluster ID: 3fdcc4815c2748cbbcbac6058de436f7
I20260811 11:49:17.763506 12352 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:17.787154 12352 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:17.788518 12352 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:17.796451 12352 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82: Generated new TSK 0
I20260811 11:49:17.797281 12352 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.244.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
Entry for principal kudu/127.20.244.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab.
I20260811 11:49:17.835529 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40603
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:33887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:17.953176 12365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:17.953565 12365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:17.953660 12365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:17.958043 12365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:17.958159 12365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:17.958266 12365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:49:17.964736 12365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:33887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.65.keytab
--principal=kudu/127.20.244.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:17.965978 12365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:17.967165 12365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:49:17.977566 12365 server_base.cc:1034] running on GCE node
W20260811 11:49:17.977582 12371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:17.977814 12374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:17.977814 12370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:17.978492 12365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:17.979218 12365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:17.980448 12365 hybrid_clock.cc:648] HybridClock initialized: now 1786448957980434 us; error 31 us; skew 500 ppm
Aug 11 11:49:17 dist-test-slave-vkjp krb5kdc[12238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448957, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:17.983628 12365 init.cc:377] Logged in from keytab as kudu/127.20.244.65@KRBTEST.COM (short username kudu)
I20260811 11:49:17.984681 12365 webserver.cc:460] Webserver started at http://127.20.244.65:38161/ using document root <none> and password file <none>
I20260811 11:49:17.985301 12365 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:17.985402 12365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:17.985658 12365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:17.987949 12365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "335178b0e81c4ad6a4926ac8be6ad785"
format_stamp: "Formatted at 2026-08-11 11:49:17 on dist-test-slave-vkjp"
server_key: "50791674df092549cf7097b9e3640cbf"
server_key_iv: "a26a62b87f3f99eae3ba25ff83fcaed2"
server_key_version: "encryptionkey@0"
I20260811 11:49:17.988574 12365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "335178b0e81c4ad6a4926ac8be6ad785"
format_stamp: "Formatted at 2026-08-11 11:49:17 on dist-test-slave-vkjp"
server_key: "50791674df092549cf7097b9e3640cbf"
server_key_iv: "a26a62b87f3f99eae3ba25ff83fcaed2"
server_key_version: "encryptionkey@0"
I20260811 11:49:17.992887 12365 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 11:49:17.995939 12382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:17.997328 12365 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:49:17.997486 12365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "335178b0e81c4ad6a4926ac8be6ad785"
format_stamp: "Formatted at 2026-08-11 11:49:17 on dist-test-slave-vkjp"
server_key: "50791674df092549cf7097b9e3640cbf"
server_key_iv: "a26a62b87f3f99eae3ba25ff83fcaed2"
server_key_version: "encryptionkey@0"
I20260811 11:49:17.997618 12365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:18.015698 12365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:18.019755 12365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:18.020000 12365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:18.020715 12365 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:49:18.021677 12365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:49:18.021751 12365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:18.021826 12365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:49:18.021875 12365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:18.031338 12365 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:46347
I20260811 11:49:18.031384 12510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:46347 every 8 connection(s)
I20260811 11:49:18.032302 12365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:49:18.034075 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 12365
I20260811 11:49:18.034217 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:49:18.034574 21457 external_mini_cluster.cc:1428] Setting key 7a533c5ef5230f63e55abd93c94e2695
Aug 11 11:49:18 dist-test-slave-vkjp krb5kdc[12238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448957, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.65@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.244.66@KRBTEST.COM; defaulting to no policy
I20260811 11:49:18.048357 12339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:18.034336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:44833 (local address 127.20.244.126:40603)
0811 11:49:18.034499 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:18.034502 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:18.035553 (+ 1051us) server_negotiation.cc:407] Connection header received
0811 11:49:18.037258 (+ 1705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:18.037261 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:18.037306 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:18.037377 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:18.038930 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.039851 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.041052 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.041515 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.041650 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:18.044349 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:18.044356 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:18.044360 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:18.044395 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:18.046240 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:18.046783 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:18.046786 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:18.046787 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:18.046868 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:18.047230 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:18.047233 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:18.047234 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:18.047418 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:18.047510 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:18.048109 (+ 599us) server_negotiation.cc:299] Negotiation successful
0811 11:49:18.048223 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.66@KRBTEST.COM" created.
I20260811 11:49:18.049453 12513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:18.034838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40603 (local address 127.20.244.65:44833)
0811 11:49:18.035393 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:18.035448 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:18.037017 (+ 1569us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:18.037563 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:18.037574 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:18.038103 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:18.038764 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:18.038780 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.040007 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.040010 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:18.040907 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:18.040916 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.041809 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.041813 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:18.041959 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:18.042622 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:18.042640 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:18.044171 (+ 1531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:18.046359 (+ 2188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:18.046365 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:18.046379 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:18.046677 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:18.046953 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:18.046955 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:18.046956 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:18.047148 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:18.047547 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:18.047553 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:18.047803 (+ 250us) client_negotiation.cc:769] Sending connection context
0811 11:49:18.048040 (+ 237us) client_negotiation.cc:240] Negotiation successful
0811 11:49:18.048324 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":181,"threads_started":1}
I20260811 11:49:18.052002 12511 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40603
I20260811 11:49:18.052284 12511 heartbeater.cc:464] Registering TS with master...
I20260811 11:49:18.052868 12511 heartbeater.cc:511] Master 127.20.244.126:40603 requested a full tablet report, sending...
I20260811 11:49:18.054561 12292 ts_manager.cc:194] Registered new tserver with Master: 335178b0e81c4ad6a4926ac8be6ad785 (127.20.244.65:46347)
I20260811 11:49:18.055850 12292 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.65@KRBTEST.COM'} at 127.20.244.65:44833
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
Entry for principal kudu/127.20.244.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab.
I20260811 11:49:18.066352 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40603
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:33887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:18.183549 12518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:18.183877 12518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:18.183979 12518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:18.188165 12518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:18.188252 12518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:18.188340 12518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:49:18.194013 12518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:33887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.66.keytab
--principal=kudu/127.20.244.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:18.195318 12518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:18.196436 12518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:18.206773 12523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:18.206773 12527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:18.206782 12524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:18.207087 12518 server_base.cc:1034] running on GCE node
I20260811 11:49:18.207809 12518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:18.208513 12518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:18.209710 12518 hybrid_clock.cc:648] HybridClock initialized: now 1786448958209690 us; error 39 us; skew 500 ppm
Aug 11 11:49:18 dist-test-slave-vkjp krb5kdc[12238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448958, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:18.212807 12518 init.cc:377] Logged in from keytab as kudu/127.20.244.66@KRBTEST.COM (short username kudu)
I20260811 11:49:18.213828 12518 webserver.cc:460] Webserver started at http://127.20.244.66:38781/ using document root <none> and password file <none>
I20260811 11:49:18.214428 12518 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:18.214531 12518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:18.214784 12518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:18.217036 12518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "561d881dac114dd9812891af58cd8772"
format_stamp: "Formatted at 2026-08-11 11:49:18 on dist-test-slave-vkjp"
server_key: "02257025982f9f25c0ac51984227b128"
server_key_iv: "7e2a8e914465338e031d01f35e9f0666"
server_key_version: "encryptionkey@0"
I20260811 11:49:18.217666 12518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "561d881dac114dd9812891af58cd8772"
format_stamp: "Formatted at 2026-08-11 11:49:18 on dist-test-slave-vkjp"
server_key: "02257025982f9f25c0ac51984227b128"
server_key_iv: "7e2a8e914465338e031d01f35e9f0666"
server_key_version: "encryptionkey@0"
I20260811 11:49:18.221992 12518 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 11:49:18.225013 12535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:18.226629 12518 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 11:49:18.226804 12518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "561d881dac114dd9812891af58cd8772"
format_stamp: "Formatted at 2026-08-11 11:49:18 on dist-test-slave-vkjp"
server_key: "02257025982f9f25c0ac51984227b128"
server_key_iv: "7e2a8e914465338e031d01f35e9f0666"
server_key_version: "encryptionkey@0"
I20260811 11:49:18.226948 12518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:18.249588 12518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:18.252736 12518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:18.252969 12518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:18.253777 12518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:49:18.254853 12518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:49:18.254921 12518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:18.254994 12518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:49:18.255038 12518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:18.264935 12518 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:46053
I20260811 11:49:18.264959 12668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:46053 every 8 connection(s)
I20260811 11:49:18.265885 12518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:49:18.274693 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 12518
I20260811 11:49:18.274889 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:49:18.275256 21457 external_mini_cluster.cc:1428] Setting key 280f5a0fb205b50fea867bb2680d9b02
Aug 11 11:49:18 dist-test-slave-vkjp krb5kdc[12238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448958, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.66@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:49:18.280678 12339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:18.267858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:34943 (local address 127.20.244.126:40603)
0811 11:49:18.268018 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:18.268022 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:18.268927 (+ 905us) server_negotiation.cc:407] Connection header received
0811 11:49:18.270361 (+ 1434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:18.270364 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:18.270452 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:18.270534 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:18.271827 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.272367 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.273491 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.273722 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.273805 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:18.276716 (+ 2911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:18.276720 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:18.276722 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:18.276754 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:18.278150 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:18.278813 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:18.278816 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:18.278817 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:18.278900 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:18.279356 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:18.279362 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:18.279366 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:18.279631 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:18.279747 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:18.280306 (+ 559us) server_negotiation.cc:299] Negotiation successful
0811 11:49:18.280461 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 11:49:18.281724 12671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:18.268284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40603 (local address 127.20.244.66:34943)
0811 11:49:18.268755 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:18.268801 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:18.270140 (+ 1339us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:18.270715 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:18.270722 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:18.271174 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:18.271678 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:18.271692 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.272491 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.272493 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:18.273373 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:18.273382 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.273863 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.273866 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:18.274020 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:18.274644 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:18.274660 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:18.276536 (+ 1876us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:18.278275 (+ 1739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:18.278284 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:18.278305 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:18.278703 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:18.278996 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:18.279002 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:18.279006 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:18.279245 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:18.279743 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:18.279748 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:18.280029 (+ 281us) client_negotiation.cc:769] Sending connection context
0811 11:49:18.280191 (+ 162us) client_negotiation.cc:240] Negotiation successful
0811 11:49:18.280539 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":128,"threads_started":1}
I20260811 11:49:18.283008 12669 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40603
I20260811 11:49:18.283301 12669 heartbeater.cc:464] Registering TS with master...
I20260811 11:49:18.283816 12669 heartbeater.cc:511] Master 127.20.244.126:40603 requested a full tablet report, sending...
I20260811 11:49:18.284915 12292 ts_manager.cc:194] Registered new tserver with Master: 561d881dac114dd9812891af58cd8772 (127.20.244.66:46053)
I20260811 11:49:18.285513 12292 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.66@KRBTEST.COM'} at 127.20.244.66:34943
WARNING: no policy specified for kudu/127.20.244.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
Entry for principal kudu/127.20.244.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab.
I20260811 11:49:18.309868 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40603
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:33887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:18.430954 12674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:18.431370 12674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:18.431488 12674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:18.436221 12674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:18.436337 12674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:18.436436 12674 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:49:18.442133 12674 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:33887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.67.keytab
--principal=kudu/127.20.244.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:40603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:18.443439 12674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:18.444518 12674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:18.454797 12683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:18.454828 12680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:18.454818 12681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:18.455058 12674 server_base.cc:1034] running on GCE node
I20260811 11:49:18.455502 12674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:18.456166 12674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:18.457330 12674 hybrid_clock.cc:648] HybridClock initialized: now 1786448958457314 us; error 25 us; skew 500 ppm
Aug 11 11:49:18 dist-test-slave-vkjp krb5kdc[12238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448958, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:18.460134 12674 init.cc:377] Logged in from keytab as kudu/127.20.244.67@KRBTEST.COM (short username kudu)
I20260811 11:49:18.461061 12674 webserver.cc:460] Webserver started at http://127.20.244.67:36575/ using document root <none> and password file <none>
I20260811 11:49:18.461680 12674 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:18.461782 12674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:18.462029 12674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:18.464267 12674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "b173b80b07f94d61af4d78ab22bc7c58"
format_stamp: "Formatted at 2026-08-11 11:49:18 on dist-test-slave-vkjp"
server_key: "b9db934e593c62612da0047c56f1cdb3"
server_key_iv: "5600eacadb9b3fe10cd2fa38a3a0b05c"
server_key_version: "encryptionkey@0"
I20260811 11:49:18.464907 12674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "b173b80b07f94d61af4d78ab22bc7c58"
format_stamp: "Formatted at 2026-08-11 11:49:18 on dist-test-slave-vkjp"
server_key: "b9db934e593c62612da0047c56f1cdb3"
server_key_iv: "5600eacadb9b3fe10cd2fa38a3a0b05c"
server_key_version: "encryptionkey@0"
I20260811 11:49:18.468917 12674 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 11:49:18.471599 12692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:18.472882 12674 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:49:18.473023 12674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "b173b80b07f94d61af4d78ab22bc7c58"
format_stamp: "Formatted at 2026-08-11 11:49:18 on dist-test-slave-vkjp"
server_key: "b9db934e593c62612da0047c56f1cdb3"
server_key_iv: "5600eacadb9b3fe10cd2fa38a3a0b05c"
server_key_version: "encryptionkey@0"
I20260811 11:49:18.473145 12674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:18.493181 12674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:18.496841 12674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:18.497066 12674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:18.497752 12674 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:49:18.498670 12674 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:49:18.498747 12674 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:18.498818 12674 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:49:18.498869 12674 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:18.508881 12674 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:39907
I20260811 11:49:18.508908 12826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:39907 every 8 connection(s)
I20260811 11:49:18.509815 12674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:49:18.518240 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 12674
I20260811 11:49:18.518481 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:49:18.518826 21457 external_mini_cluster.cc:1428] Setting key 93f1b9647316484b078a2e567cdbe799
Aug 11 11:49:18 dist-test-slave-vkjp krb5kdc[12238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448958, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.67@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:49:18.524906 12339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:18.511751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:56401 (local address 127.20.244.126:40603)
0811 11:49:18.511908 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:18.511913 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:18.512873 (+ 960us) server_negotiation.cc:407] Connection header received
0811 11:49:18.514280 (+ 1407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:18.514283 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:18.514331 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:18.514408 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:18.515816 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.516364 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.517609 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.517854 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.517941 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:18.521130 (+ 3189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:18.521134 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:18.521136 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:18.521173 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:18.522685 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:18.523308 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:18.523313 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:18.523314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:18.523401 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:18.523765 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:18.523768 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:18.523770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:18.523964 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:18.524083 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:18.524615 (+ 532us) server_negotiation.cc:299] Negotiation successful
0811 11:49:18.524741 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 11:49:18.525776 12829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:18.512180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:40603 (local address 127.20.244.67:56401)
0811 11:49:18.512698 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:18.512749 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:18.514066 (+ 1317us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:18.514594 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:18.514601 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:18.514977 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:18.515656 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:18.515672 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.516510 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.516513 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:18.517479 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:18.517489 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.518058 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.518063 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:18.518297 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:18.519071 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:18.519114 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:18.520937 (+ 1823us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:18.522815 (+ 1878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:18.522822 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:18.522839 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:18.523204 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:18.523503 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:18.523506 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:18.523508 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:18.523658 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:18.524082 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:18.524091 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:18.524358 (+ 267us) client_negotiation.cc:769] Sending connection context
0811 11:49:18.524554 (+ 196us) client_negotiation.cc:240] Negotiation successful
0811 11:49:18.524906 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":129,"threads_started":1}
I20260811 11:49:18.526937 12827 heartbeater.cc:347] Connected to a master server at 127.20.244.126:40603
I20260811 11:49:18.527254 12827 heartbeater.cc:464] Registering TS with master...
I20260811 11:49:18.527798 12827 heartbeater.cc:511] Master 127.20.244.126:40603 requested a full tablet report, sending...
I20260811 11:49:18.528915 12292 ts_manager.cc:194] Registered new tserver with Master: b173b80b07f94d61af4d78ab22bc7c58 (127.20.244.67:39907)
I20260811 11:49:18.529572 12292 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.244.67@KRBTEST.COM'} at 127.20.244.67:56401
I20260811 11:49:18.533357 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:49:18.543812 12339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:18.535577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39154 (local address 127.20.244.126:40603)
0811 11:49:18.535745 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:18.535751 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:18.535981 (+ 230us) server_negotiation.cc:407] Connection header received
0811 11:49:18.536157 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:18.536161 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:18.536217 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:18.536310 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:18.537087 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.537695 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.538654 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.538914 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.539031 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:18.540508 (+ 1477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:18.540512 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:18.540516 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:18.540544 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:18.541878 (+ 1334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:18.542350 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:18.542354 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:18.542356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:18.542452 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:18.542764 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:18.542767 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:18.542769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:18.543021 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:18.543213 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:18.543490 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 11:49:18.543625 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 11:49:18.546829 12292 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39154:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:49:18.550254 12292 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:49:18.567654 12844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:18.561576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38968 (local address 127.20.244.65:46347)
0811 11:49:18.562306 (+ 730us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:18.562314 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:18.562336 (+ 22us) server_negotiation.cc:407] Connection header received
0811 11:49:18.562412 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:18.562417 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:18.562591 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:18.562739 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:18.564056 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.565182 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.566331 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.566988 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.567142 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:18.567294 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:18.567423 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 11:49:18.567528 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":112,"threads_started":1}
I20260811 11:49:18.567649 12840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:18.560504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54164 (local address 127.20.244.67:39907)
0811 11:49:18.561350 (+ 846us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:18.561365 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:18.561881 (+ 516us) server_negotiation.cc:407] Connection header received
0811 11:49:18.562169 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:18.562177 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:18.562389 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:18.562522 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:18.563068 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.564193 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.566012 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.566737 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.566826 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:18.566939 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:18.567298 (+ 359us) server_negotiation.cc:299] Negotiation successful
0811 11:49:18.567476 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":720,"thread_start_us":742,"threads_started":1}
I20260811 11:49:18.567682 12841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:18.560835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:46347 (local address 127.0.0.1:38968)
0811 11:49:18.561935 (+ 1100us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:18.561949 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:18.562050 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:18.562728 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:18.562730 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:18.562752 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:18.562929 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:18.562937 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.565306 (+ 2369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.565312 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:18.566185 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:18.566204 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.567154 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.567158 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:18.567263 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:18.567302 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 11:49:18.567380 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 11:49:18.567505 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1041,"mutex_wait_us":701,"thread_start_us":99,"threads_started":1}
I20260811 11:49:18.568087 12843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:18.560832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:39907 (local address 127.0.0.1:54164)
0811 11:49:18.561767 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:18.561784 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:18.561969 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:18.562708 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:18.562712 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:18.562732 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:18.562929 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:18.562937 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.564344 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.564424 (+ 80us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:18.565869 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:18.565881 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.566868 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.566871 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:18.567002 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:18.567100 (+ 98us) client_negotiation.cc:769] Sending connection context
0811 11:49:18.567880 (+ 780us) client_negotiation.cc:240] Negotiation successful
0811 11:49:18.567959 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":858,"mutex_wait_us":141,"thread_start_us":344,"threads_started":1}
I20260811 11:49:18.568455 12838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:18.559880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:46053 (local address 127.0.0.1:53524)
0811 11:49:18.560670 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:18.560735 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:18.560899 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:18.562103 (+ 1204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:18.562109 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:18.562134 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:18.562289 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:18.562297 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.564025 (+ 1728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.564028 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:18.565869 (+ 1841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:18.565881 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.568066 (+ 2185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.568070 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:18.568169 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:18.568192 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 11:49:18.568245 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 11:49:18.568316 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"mutex_wait_us":103,"thread_start_us":142,"threads_started":1}
I20260811 11:49:18.569121 12842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:18.561187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53524 (local address 127.20.244.66:46053)
0811 11:49:18.561556 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:18.561570 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:18.561598 (+ 28us) server_negotiation.cc:407] Connection header received
0811 11:49:18.561683 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:18.561689 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:18.561913 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:18.562458 (+ 545us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:18.562635 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.563866 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.566993 (+ 3127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.567903 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.568646 (+ 743us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:18.568810 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:18.568852 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 11:49:18.568976 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":121,"threads_started":1}
I20260811 11:49:18.571342 12439 tablet_service.cc:1467] Processing CreateTablet for tablet be404f0e5b494bec93381586fdc855ea (DEFAULT_TABLE table=test-table [id=6e0339a3cbcd49bfa814df6e65139324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:49:18.571581 12590 tablet_service.cc:1467] Processing CreateTablet for tablet be404f0e5b494bec93381586fdc855ea (DEFAULT_TABLE table=test-table [id=6e0339a3cbcd49bfa814df6e65139324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:49:18.571843 12747 tablet_service.cc:1467] Processing CreateTablet for tablet be404f0e5b494bec93381586fdc855ea (DEFAULT_TABLE table=test-table [id=6e0339a3cbcd49bfa814df6e65139324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:49:18.572568 12439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be404f0e5b494bec93381586fdc855ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:18.572588 12590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be404f0e5b494bec93381586fdc855ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:18.572737 12747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be404f0e5b494bec93381586fdc855ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:18.579339 12845 tablet_bootstrap.cc:492] T be404f0e5b494bec93381586fdc855ea P 561d881dac114dd9812891af58cd8772: Bootstrap starting.
I20260811 11:49:18.580387 12846 tablet_bootstrap.cc:492] T be404f0e5b494bec93381586fdc855ea P 335178b0e81c4ad6a4926ac8be6ad785: Bootstrap starting.
I20260811 11:49:18.581602 12845 tablet_bootstrap.cc:654] T be404f0e5b494bec93381586fdc855ea P 561d881dac114dd9812891af58cd8772: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:18.582170 12846 tablet_bootstrap.cc:654] T be404f0e5b494bec93381586fdc855ea P 335178b0e81c4ad6a4926ac8be6ad785: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:18.582751 12845 log.cc:824] T be404f0e5b494bec93381586fdc855ea P 561d881dac114dd9812891af58cd8772: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:18.582885 12846 log.cc:824] T be404f0e5b494bec93381586fdc855ea P 335178b0e81c4ad6a4926ac8be6ad785: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:18.583459 12847 tablet_bootstrap.cc:492] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58: Bootstrap starting.
I20260811 11:49:18.584837 12845 tablet_bootstrap.cc:492] T be404f0e5b494bec93381586fdc855ea P 561d881dac114dd9812891af58cd8772: No bootstrap required, opened a new log
I20260811 11:49:18.585052 12845 ts_tablet_manager.cc:1397] T be404f0e5b494bec93381586fdc855ea P 561d881dac114dd9812891af58cd8772: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260811 11:49:18.585379 12847 tablet_bootstrap.cc:654] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:18.586390 12847 log.cc:824] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:18.588423 12847 tablet_bootstrap.cc:492] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58: No bootstrap required, opened a new log
I20260811 11:49:18.588630 12847 ts_tablet_manager.cc:1397] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 11:49:18.588915 12846 tablet_bootstrap.cc:492] T be404f0e5b494bec93381586fdc855ea P 335178b0e81c4ad6a4926ac8be6ad785: No bootstrap required, opened a new log
I20260811 11:49:18.588846 12845 raft_consensus.cc:348] T be404f0e5b494bec93381586fdc855ea P 561d881dac114dd9812891af58cd8772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561d881dac114dd9812891af58cd8772" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 46053 } } peers { permanent_uuid: "335178b0e81c4ad6a4926ac8be6ad785" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46347 } } peers { permanent_uuid: "b173b80b07f94d61af4d78ab22bc7c58" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 39907 } }
I20260811 11:49:18.589116 12846 ts_tablet_manager.cc:1397] T be404f0e5b494bec93381586fdc855ea P 335178b0e81c4ad6a4926ac8be6ad785: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260811 11:49:18.589133 12845 raft_consensus.cc:374] T be404f0e5b494bec93381586fdc855ea P 561d881dac114dd9812891af58cd8772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:18.589186 12845 raft_consensus.cc:729] T be404f0e5b494bec93381586fdc855ea P 561d881dac114dd9812891af58cd8772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561d881dac114dd9812891af58cd8772, State: Initialized, Role: FOLLOWER
I20260811 11:49:18.589681 12845 consensus_queue.cc:260] T be404f0e5b494bec93381586fdc855ea P 561d881dac114dd9812891af58cd8772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561d881dac114dd9812891af58cd8772" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 46053 } } peers { permanent_uuid: "335178b0e81c4ad6a4926ac8be6ad785" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46347 } } peers { permanent_uuid: "b173b80b07f94d61af4d78ab22bc7c58" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 39907 } }
I20260811 11:49:18.590407 12669 heartbeater.cc:503] Master 127.20.244.126:40603 was elected leader, sending a full tablet report...
I20260811 11:49:18.592294 12847 raft_consensus.cc:348] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561d881dac114dd9812891af58cd8772" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 46053 } } peers { permanent_uuid: "335178b0e81c4ad6a4926ac8be6ad785" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46347 } } peers { permanent_uuid: "b173b80b07f94d61af4d78ab22bc7c58" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 39907 } }
I20260811 11:49:18.592583 12847 raft_consensus.cc:374] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:18.592646 12847 raft_consensus.cc:729] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b173b80b07f94d61af4d78ab22bc7c58, State: Initialized, Role: FOLLOWER
I20260811 11:49:18.593092 12847 consensus_queue.cc:260] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561d881dac114dd9812891af58cd8772" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 46053 } } peers { permanent_uuid: "335178b0e81c4ad6a4926ac8be6ad785" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46347 } } peers { permanent_uuid: "b173b80b07f94d61af4d78ab22bc7c58" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 39907 } }
I20260811 11:49:18.593578 12846 raft_consensus.cc:348] T be404f0e5b494bec93381586fdc855ea P 335178b0e81c4ad6a4926ac8be6ad785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561d881dac114dd9812891af58cd8772" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 46053 } } peers { permanent_uuid: "335178b0e81c4ad6a4926ac8be6ad785" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46347 } } peers { permanent_uuid: "b173b80b07f94d61af4d78ab22bc7c58" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 39907 } }
I20260811 11:49:18.593863 12827 heartbeater.cc:503] Master 127.20.244.126:40603 was elected leader, sending a full tablet report...
I20260811 11:49:18.593873 12846 raft_consensus.cc:374] T be404f0e5b494bec93381586fdc855ea P 335178b0e81c4ad6a4926ac8be6ad785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:18.593927 12846 raft_consensus.cc:729] T be404f0e5b494bec93381586fdc855ea P 335178b0e81c4ad6a4926ac8be6ad785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 335178b0e81c4ad6a4926ac8be6ad785, State: Initialized, Role: FOLLOWER
I20260811 11:49:18.594202 12847 ts_tablet_manager.cc:1428] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 11:49:18.594389 12846 consensus_queue.cc:260] T be404f0e5b494bec93381586fdc855ea P 335178b0e81c4ad6a4926ac8be6ad785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561d881dac114dd9812891af58cd8772" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 46053 } } peers { permanent_uuid: "335178b0e81c4ad6a4926ac8be6ad785" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46347 } } peers { permanent_uuid: "b173b80b07f94d61af4d78ab22bc7c58" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 39907 } }
I20260811 11:49:18.595211 12511 heartbeater.cc:503] Master 127.20.244.126:40603 was elected leader, sending a full tablet report...
I20260811 11:49:18.595441 12846 ts_tablet_manager.cc:1428] T be404f0e5b494bec93381586fdc855ea P 335178b0e81c4ad6a4926ac8be6ad785: Time spent starting tablet: real 0.006s user 0.002s sys 0.005s
I20260811 11:49:18.595824 12845 ts_tablet_manager.cc:1428] T be404f0e5b494bec93381586fdc855ea P 561d881dac114dd9812891af58cd8772: Time spent starting tablet: real 0.011s user 0.005s sys 0.002s
W20260811 11:49:18.760950 12828 tablet.cc:2369] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:49:18.767100 12670 tablet.cc:2369] T be404f0e5b494bec93381586fdc855ea P 561d881dac114dd9812891af58cd8772: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:49:18.783808 12512 tablet.cc:2369] T be404f0e5b494bec93381586fdc855ea P 335178b0e81c4ad6a4926ac8be6ad785: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:49:18.931283 12854 raft_consensus.cc:482] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:49:18.931538 12854 raft_consensus.cc:504] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561d881dac114dd9812891af58cd8772" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 46053 } } peers { permanent_uuid: "335178b0e81c4ad6a4926ac8be6ad785" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46347 } } peers { permanent_uuid: "b173b80b07f94d61af4d78ab22bc7c58" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 39907 } }
I20260811 11:49:18.932900 12854 leader_election.cc:288] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561d881dac114dd9812891af58cd8772 (127.20.244.66:46053), 335178b0e81c4ad6a4926ac8be6ad785 (127.20.244.65:46347)
I20260811 11:49:18.937852 12829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:18.933283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:46053 (local address 127.20.244.67:51111)
0811 11:49:18.933422 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:18.933440 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:18.933574 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:18.934005 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:18.934010 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:18.934035 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:18.934179 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:18.934186 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.935213 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.935216 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:18.936458 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:18.936469 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.937334 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.937337 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:18.937455 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:18.937520 (+ 65us) client_negotiation.cc:769] Sending connection context
0811 11:49:18.937599 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 11:49:18.937687 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":25}
I20260811 11:49:18.937881 12842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:18.933428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:51111 (local address 127.20.244.66:46053)
0811 11:49:18.933588 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:18.933595 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:18.933674 (+ 79us) server_negotiation.cc:407] Connection header received
0811 11:49:18.933741 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:18.933747 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:18.933804 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:18.933935 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:18.934289 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.935071 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.936591 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.937213 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.937339 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:18.937402 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:18.937630 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 11:49:18.937728 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 11:49:18.937901 12844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:18.933827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:54063 (local address 127.20.244.65:46347)
0811 11:49:18.933959 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:18.933963 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:18.934099 (+ 136us) server_negotiation.cc:407] Connection header received
0811 11:49:18.934197 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:18.934199 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:18.934270 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:18.934355 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:18.934671 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.935375 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.936736 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.937361 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.937471 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:18.937517 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:18.937718 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 11:49:18.937792 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 11:49:18.937860 12856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:18.933630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:46347 (local address 127.20.244.67:54063)
0811 11:49:18.933998 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:18.934011 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:18.934099 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:18.934385 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:18.934390 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:18.934414 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:18.934536 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:18.934542 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.935472 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.935475 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:18.936621 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:18.936628 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:18.937469 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:18.937472 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:18.937599 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:18.937621 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 11:49:18.937685 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 11:49:18.937736 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":5,"thread_start_us":170,"threads_started":1}
I20260811 11:49:18.938596 12614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be404f0e5b494bec93381586fdc855ea" candidate_uuid: "b173b80b07f94d61af4d78ab22bc7c58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561d881dac114dd9812891af58cd8772" is_pre_election: true
I20260811 11:49:18.938789 12460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be404f0e5b494bec93381586fdc855ea" candidate_uuid: "b173b80b07f94d61af4d78ab22bc7c58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "335178b0e81c4ad6a4926ac8be6ad785" is_pre_election: true
I20260811 11:49:18.938964 12614 raft_consensus.cc:2454] T be404f0e5b494bec93381586fdc855ea P 561d881dac114dd9812891af58cd8772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b173b80b07f94d61af4d78ab22bc7c58 in term 0.
I20260811 11:49:18.939121 12460 raft_consensus.cc:2454] T be404f0e5b494bec93381586fdc855ea P 335178b0e81c4ad6a4926ac8be6ad785 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b173b80b07f94d61af4d78ab22bc7c58 in term 0.
I20260811 11:49:18.939524 12694 leader_election.cc:302] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561d881dac114dd9812891af58cd8772, b173b80b07f94d61af4d78ab22bc7c58; no voters:
I20260811 11:49:18.939770 12854 raft_consensus.cc:2781] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:49:18.939870 12854 raft_consensus.cc:482] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:49:18.939960 12854 raft_consensus.cc:3037] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:18.941377 12854 raft_consensus.cc:504] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561d881dac114dd9812891af58cd8772" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 46053 } } peers { permanent_uuid: "335178b0e81c4ad6a4926ac8be6ad785" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46347 } } peers { permanent_uuid: "b173b80b07f94d61af4d78ab22bc7c58" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 39907 } }
I20260811 11:49:18.941742 12854 leader_election.cc:288] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58 [CANDIDATE]: Term 1 election: Requested vote from peers 561d881dac114dd9812891af58cd8772 (127.20.244.66:46053), 335178b0e81c4ad6a4926ac8be6ad785 (127.20.244.65:46347)
I20260811 11:49:18.942299 12614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be404f0e5b494bec93381586fdc855ea" candidate_uuid: "b173b80b07f94d61af4d78ab22bc7c58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561d881dac114dd9812891af58cd8772"
I20260811 11:49:18.942322 12460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be404f0e5b494bec93381586fdc855ea" candidate_uuid: "b173b80b07f94d61af4d78ab22bc7c58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "335178b0e81c4ad6a4926ac8be6ad785"
I20260811 11:49:18.942459 12614 raft_consensus.cc:3037] T be404f0e5b494bec93381586fdc855ea P 561d881dac114dd9812891af58cd8772 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:18.942459 12460 raft_consensus.cc:3037] T be404f0e5b494bec93381586fdc855ea P 335178b0e81c4ad6a4926ac8be6ad785 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:18.943919 12614 raft_consensus.cc:2454] T be404f0e5b494bec93381586fdc855ea P 561d881dac114dd9812891af58cd8772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b173b80b07f94d61af4d78ab22bc7c58 in term 1.
I20260811 11:49:18.943921 12460 raft_consensus.cc:2454] T be404f0e5b494bec93381586fdc855ea P 335178b0e81c4ad6a4926ac8be6ad785 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b173b80b07f94d61af4d78ab22bc7c58 in term 1.
I20260811 11:49:18.944280 12694 leader_election.cc:302] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 335178b0e81c4ad6a4926ac8be6ad785, b173b80b07f94d61af4d78ab22bc7c58; no voters:
I20260811 11:49:18.944468 12854 raft_consensus.cc:2781] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:18.944723 12854 raft_consensus.cc:686] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58 [term 1 LEADER]: Becoming Leader. State: Replica: b173b80b07f94d61af4d78ab22bc7c58, State: Running, Role: LEADER
I20260811 11:49:18.945079 12854 consensus_queue.cc:237] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561d881dac114dd9812891af58cd8772" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 46053 } } peers { permanent_uuid: "335178b0e81c4ad6a4926ac8be6ad785" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46347 } } peers { permanent_uuid: "b173b80b07f94d61af4d78ab22bc7c58" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 39907 } }
I20260811 11:49:18.948498 12287 catalog_manager.cc:5495] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58 reported cstate change: term changed from 0 to 1, leader changed from <none> to b173b80b07f94d61af4d78ab22bc7c58 (127.20.244.67). New cstate: current_term: 1 leader_uuid: "b173b80b07f94d61af4d78ab22bc7c58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561d881dac114dd9812891af58cd8772" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 46053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "335178b0e81c4ad6a4926ac8be6ad785" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b173b80b07f94d61af4d78ab22bc7c58" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 39907 } health_report { overall_health: HEALTHY } } }
I20260811 11:49:19.024241 12840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:19.020339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54178 (local address 127.20.244.67:39907)
0811 11:49:19.020531 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:19.020536 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:19.020552 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:49:19.020667 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:19.020669 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:19.020730 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:19.020853 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:49:19.021142 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:19.021668 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:19.022559 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:19.022783 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:19.022901 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:19.023270 (+ 369us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:49:19.023744 (+ 474us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:49:19.023884 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:19.023948 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 11:49:19.024043 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 11:49:19.030639 12460 raft_consensus.cc:1261] T be404f0e5b494bec93381586fdc855ea P 335178b0e81c4ad6a4926ac8be6ad785 [term 1 FOLLOWER]: Refusing update from remote peer b173b80b07f94d61af4d78ab22bc7c58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:49:19.030639 12614 raft_consensus.cc:1261] T be404f0e5b494bec93381586fdc855ea P 561d881dac114dd9812891af58cd8772 [term 1 FOLLOWER]: Refusing update from remote peer b173b80b07f94d61af4d78ab22bc7c58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:49:19.031493 12854 consensus_queue.cc:1035] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561d881dac114dd9812891af58cd8772" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 46053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:49:19.031735 12857 consensus_queue.cc:1035] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "335178b0e81c4ad6a4926ac8be6ad785" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 46347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:49:19.043357 12862 mvcc.cc:205] Tried to move back new op lower bound from 7317294936181157888 to 7317294935841681408. Current Snapshot: MvccSnapshot[applied={T|T < 7317294936181157888}]
I20260811 11:49:19.050444 12287 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39154:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:49:19.050653 12287 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39154:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:49:19.053501 12287 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3a9bb4732dcd4e6caa88215133c40a82: Sending DeleteTablet for 3 replicas of tablet be404f0e5b494bec93381586fdc855ea
I20260811 11:49:19.054505 12439 tablet_service.cc:1514] Processing DeleteTablet for tablet be404f0e5b494bec93381586fdc855ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:49:19 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:38968
I20260811 11:49:19.054555 12747 tablet_service.cc:1514] Processing DeleteTablet for tablet be404f0e5b494bec93381586fdc855ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:49:19 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:54164
I20260811 11:49:19.054858 12590 tablet_service.cc:1514] Processing DeleteTablet for tablet be404f0e5b494bec93381586fdc855ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:49:19 UTC) from {username='kudu', principal='kudu/127.20.244.126@KRBTEST.COM'} at 127.0.0.1:53524
I20260811 11:49:19.055111 12872 tablet_replica.cc:330] T be404f0e5b494bec93381586fdc855ea P 335178b0e81c4ad6a4926ac8be6ad785: stopping tablet replica
I20260811 11:49:19.055501 12872 raft_consensus.cc:2229] T be404f0e5b494bec93381586fdc855ea P 335178b0e81c4ad6a4926ac8be6ad785 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:49:19.055646 12874 tablet_replica.cc:330] T be404f0e5b494bec93381586fdc855ea P 561d881dac114dd9812891af58cd8772: stopping tablet replica
I20260811 11:49:19.055646 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 12365
I20260811 11:49:19.057500 12874 raft_consensus.cc:2229] T be404f0e5b494bec93381586fdc855ea P 561d881dac114dd9812891af58cd8772 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:49:19.057870 12874 raft_consensus.cc:2258] T be404f0e5b494bec93381586fdc855ea P 561d881dac114dd9812891af58cd8772 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:49:19.059783 12873 tablet_replica.cc:330] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58: stopping tablet replica
I20260811 11:49:19.060115 12873 raft_consensus.cc:2229] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:49:19.060163 12874 ts_tablet_manager.cc:1905] T be404f0e5b494bec93381586fdc855ea P 561d881dac114dd9812891af58cd8772: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:49:19.060554 12873 raft_consensus.cc:2258] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:49:19.061975 12873 ts_tablet_manager.cc:1905] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:49:19.064669 12874 ts_tablet_manager.cc:1918] T be404f0e5b494bec93381586fdc855ea P 561d881dac114dd9812891af58cd8772: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:49:19.064852 12874 log.cc:1196] T be404f0e5b494bec93381586fdc855ea P 561d881dac114dd9812891af58cd8772: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/be404f0e5b494bec93381586fdc855ea
I20260811 11:49:19.064900 12873 ts_tablet_manager.cc:1918] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:49:19.065004 12873 log.cc:1196] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/be404f0e5b494bec93381586fdc855ea
I20260811 11:49:19.065327 12873 ts_tablet_manager.cc:1939] T be404f0e5b494bec93381586fdc855ea P b173b80b07f94d61af4d78ab22bc7c58: Deleting consensus metadata
I20260811 11:49:19.065711 12874 ts_tablet_manager.cc:1939] T be404f0e5b494bec93381586fdc855ea P 561d881dac114dd9812891af58cd8772: Deleting consensus metadata
I20260811 11:49:19.066690 12278 catalog_manager.cc:4841] TS b173b80b07f94d61af4d78ab22bc7c58 (127.20.244.67:39907): tablet be404f0e5b494bec93381586fdc855ea (table test-table [id=6e0339a3cbcd49bfa814df6e65139324]) successfully deleted
W20260811 11:49:19.066692 12275 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.244.65:46347 (error 108)
I20260811 11:49:19.067214 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 12518
I20260811 11:49:19.074957 12876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:19.074301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:46347 (local address 127.0.0.1:38978)
0811 11:49:19.074741 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:19.074825 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.65:46347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":73,"threads_started":1}
W20260811 11:49:19.075151 12275 catalog_manager.cc:4584] TS 335178b0e81c4ad6a4926ac8be6ad785 (127.20.244.65:46347): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet be404f0e5b494bec93381586fdc855ea: Network error: Client connection negotiation failed: client connection to 127.20.244.65:46347: connect: Connection refused (error 111)
I20260811 11:49:19.078485 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 12674
I20260811 11:49:19.080245 12876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:19.078331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:46053 (local address 127.0.0.1:53538)
0811 11:49:19.078504 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:19.080117 (+ 1613us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.66:46053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260811 11:49:19.088320 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 12256
2026-08-11T11:49:19Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2922 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T11:49:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:19Z Disabled control of system clock
I20260811 11:49:19.125836 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:45699
--webserver_interface=127.20.244.126
--webserver_port=0
--builtin_ntp_servers=127.20.244.84:34769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:45699
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 11:49:19.248389 12880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:19.248718 12880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:19.248756 12880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:19.253115 12880 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:19.253196 12880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:19.253211 12880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:19.253229 12880 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:19.253245 12880 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:19.258332 12880 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:34769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:45699
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:45699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12880
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:19.259668 12880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:19.261061 12880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:49:19.270326 12880 server_base.cc:1034] running on GCE node
W20260811 11:49:19.270275 12889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:19.270344 12891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:19.270275 12888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:19.271303 12880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:19.272449 12880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:19.273667 12880 hybrid_clock.cc:648] HybridClock initialized: now 1786448959273652 us; error 28 us; skew 500 ppm
I20260811 11:49:19.275990 12880 webserver.cc:460] Webserver started at http://127.20.244.126:33331/ using document root <none> and password file <none>
I20260811 11:49:19.276684 12880 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:19.276794 12880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:19.277101 12880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:19.279553 12880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "46370b8353b849dc97b859ef210dc589"
format_stamp: "Formatted at 2026-08-11 11:49:19 on dist-test-slave-vkjp"
server_key: "fe53146157e6e7ff8f420313e1844b4b"
server_key_iv: "9f672df962c3a4ea940a6a9d8db924a3"
server_key_version: "encryptionkey@0"
I20260811 11:49:19.280228 12880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "46370b8353b849dc97b859ef210dc589"
format_stamp: "Formatted at 2026-08-11 11:49:19 on dist-test-slave-vkjp"
server_key: "fe53146157e6e7ff8f420313e1844b4b"
server_key_iv: "9f672df962c3a4ea940a6a9d8db924a3"
server_key_version: "encryptionkey@0"
I20260811 11:49:19.284766 12880 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 11:49:19.287532 12897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:19.288875 12880 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:49:19.289033 12880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "46370b8353b849dc97b859ef210dc589"
format_stamp: "Formatted at 2026-08-11 11:49:19 on dist-test-slave-vkjp"
server_key: "fe53146157e6e7ff8f420313e1844b4b"
server_key_iv: "9f672df962c3a4ea940a6a9d8db924a3"
server_key_version: "encryptionkey@0"
I20260811 11:49:19.289168 12880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:19.317193 12880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:19.318005 12880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:19.318235 12880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:19.325919 12880 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:45699
I20260811 11:49:19.325963 12960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:45699 every 8 connection(s)
I20260811 11:49:19.326977 12880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:19.330374 12961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:19.333482 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 12880
I20260811 11:49:19.333633 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:19.333959 21457 external_mini_cluster.cc:1428] Setting key d4793e4b7dcccdd5a5682939cbae6161
I20260811 11:49:19.337039 12961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589: Bootstrap starting.
I20260811 11:49:19.339423 12961 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:19.340220 12961 log.cc:824] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:19.342260 12961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589: No bootstrap required, opened a new log
I20260811 11:49:19.343818 12964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:19.335563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59228 (local address 127.20.244.126:45699)
0811 11:49:19.336250 (+ 687us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:19.336266 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:19.336305 (+ 39us) server_negotiation.cc:407] Connection header received
0811 11:49:19.336952 (+ 647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:19.336970 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:19.337437 (+ 467us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:19.337820 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:19.338288 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:19.339342 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:19.340300 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:19.340854 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:19.341055 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:19.341954 (+ 899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:19.341960 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:19.341975 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:19.342398 (+ 423us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:19.342487 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:19.342511 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:19.342621 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:19.342761 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 11:49:19.343033 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":139,"threads_started":1}
I20260811 11:49:19.346511 12961 raft_consensus.cc:348] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46370b8353b849dc97b859ef210dc589" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45699 } }
I20260811 11:49:19.346776 12961 raft_consensus.cc:374] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:19.346854 12961 raft_consensus.cc:729] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46370b8353b849dc97b859ef210dc589, State: Initialized, Role: FOLLOWER
I20260811 11:49:19.347347 12961 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46370b8353b849dc97b859ef210dc589" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45699 } }
I20260811 11:49:19.347502 12961 raft_consensus.cc:388] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:19.347589 12961 raft_consensus.cc:482] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:19.347690 12961 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:19.348724 12961 raft_consensus.cc:504] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46370b8353b849dc97b859ef210dc589" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45699 } }
I20260811 11:49:19.349083 12961 leader_election.cc:302] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46370b8353b849dc97b859ef210dc589; no voters:
I20260811 11:49:19.349434 12961 leader_election.cc:288] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:19.349715 12968 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:19.349962 12968 raft_consensus.cc:686] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589 [term 1 LEADER]: Becoming Leader. State: Replica: 46370b8353b849dc97b859ef210dc589, State: Running, Role: LEADER
I20260811 11:49:19.350268 12968 consensus_queue.cc:237] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46370b8353b849dc97b859ef210dc589" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45699 } }
I20260811 11:49:19.350852 12961 sys_catalog.cc:564] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:19.352015 12971 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46370b8353b849dc97b859ef210dc589. Latest consensus state: current_term: 1 leader_uuid: "46370b8353b849dc97b859ef210dc589" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46370b8353b849dc97b859ef210dc589" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45699 } } }
I20260811 11:49:19.352164 12971 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:19.352471 12970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "46370b8353b849dc97b859ef210dc589" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46370b8353b849dc97b859ef210dc589" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45699 } } }
I20260811 11:49:19.352569 12980 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:19.352598 12970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:19.355674 12980 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:19.361786 12980 catalog_manager.cc:1347] Generated new cluster ID: 91d1e3f5f2b743bca4611172950bfcf3
I20260811 11:49:19.361878 12980 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:19.372435 12980 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:19.373486 12980 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:19.380398 12980 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589: Generated new TSK 0
I20260811 11:49:19.381197 12980 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:49:19.392668 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.65:0
--local_ip_for_outbound_sockets=127.20.244.65
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:45699
--builtin_ntp_servers=127.20.244.84:34769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 11:49:19.514585 12993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:19.514889 12993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:19.514930 12993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:19.518944 12993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:19.519007 12993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:19.519062 12993 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.65
I20260811 11:49:19.524082 12993 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:34769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.244.65
--webserver_port=0
--tserver_master_addrs=127.20.244.126:45699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12993
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.65
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:19.525236 12993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:19.526607 12993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:19.537067 13002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:19.537097 12999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:19.537101 13000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:19.537293 12993 server_base.cc:1034] running on GCE node
I20260811 11:49:19.537851 12993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:19.538560 12993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:19.539731 12993 hybrid_clock.cc:648] HybridClock initialized: now 1786448959539716 us; error 31 us; skew 500 ppm
I20260811 11:49:19.541836 12993 webserver.cc:460] Webserver started at http://127.20.244.65:41593/ using document root <none> and password file <none>
I20260811 11:49:19.542450 12993 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:19.542524 12993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:19.542750 12993 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:19.544943 12993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-0/data/instance:
uuid: "e39d712b98c9439283ea686de872b921"
format_stamp: "Formatted at 2026-08-11 11:49:19 on dist-test-slave-vkjp"
server_key: "1cafbcdf1c1939b37e01973d56d2a806"
server_key_iv: "73ead231364306f2bdf72a9f945588f0"
server_key_version: "encryptionkey@0"
I20260811 11:49:19.545725 12993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance:
uuid: "e39d712b98c9439283ea686de872b921"
format_stamp: "Formatted at 2026-08-11 11:49:19 on dist-test-slave-vkjp"
server_key: "1cafbcdf1c1939b37e01973d56d2a806"
server_key_iv: "73ead231364306f2bdf72a9f945588f0"
server_key_version: "encryptionkey@0"
I20260811 11:49:19.551411 12993 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 11:49:19.555137 13009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:19.556842 12993 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 11:49:19.556954 12993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-0/wal
uuid: "e39d712b98c9439283ea686de872b921"
format_stamp: "Formatted at 2026-08-11 11:49:19 on dist-test-slave-vkjp"
server_key: "1cafbcdf1c1939b37e01973d56d2a806"
server_key_iv: "73ead231364306f2bdf72a9f945588f0"
server_key_version: "encryptionkey@0"
I20260811 11:49:19.557124 12993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:19.570302 12993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:19.571147 12993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:19.571353 12993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:19.572003 12993 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:49:19.573040 12993 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:49:19.573092 12993 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:19.573134 12993 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:49:19.573189 12993 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:19.582618 12993 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.65:34335
I20260811 11:49:19.582644 13140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.65:34335 every 8 connection(s)
I20260811 11:49:19.583695 12993 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-0/data/info.pb
I20260811 11:49:19.591295 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 12993
I20260811 11:49:19.591521 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-0/wal/instance
I20260811 11:49:19.591879 21457 external_mini_cluster.cc:1428] Setting key 368596f536331399542bbd177cf8822c
I20260811 11:49:19.594341 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.66:0
--local_ip_for_outbound_sockets=127.20.244.66
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:45699
--builtin_ntp_servers=127.20.244.84:34769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 11:49:19.597774 12964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:19.585907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.65:43881 (local address 127.20.244.126:45699)
0811 11:49:19.586086 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:19.586090 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:19.588078 (+ 1988us) server_negotiation.cc:407] Connection header received
0811 11:49:19.590598 (+ 2520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:19.590615 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:19.590682 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:19.590836 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:19.592864 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:19.593848 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:19.595554 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:19.595801 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:19.595927 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:19.597220 (+ 1293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:19.597224 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:19.597227 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:19.597245 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:19.597273 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:19.597281 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:19.597367 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:19.597548 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 11:49:19.597619 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 11:49:19.598743 13143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:19.586361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:45699 (local address 127.20.244.65:43881)
0811 11:49:19.587826 (+ 1465us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:19.587897 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:19.590221 (+ 2324us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:19.591727 (+ 1506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:19.591741 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:19.591883 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:19.592700 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:19.592728 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:19.593997 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:19.594000 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:19.595410 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:19.595422 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:19.595983 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:19.595988 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:19.596196 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:19.596920 (+ 724us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:49:19.596921 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:19.596969 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:49:19.597043 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:19.597370 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:19.597383 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:19.597390 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 11:49:19.597536 (+ 146us) client_negotiation.cc:240] Negotiation successful
0811 11:49:19.597877 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":849,"thread_start_us":150,"threads_started":1}
I20260811 11:49:19.600203 13141 heartbeater.cc:347] Connected to a master server at 127.20.244.126:45699
I20260811 11:49:19.600519 13141 heartbeater.cc:464] Registering TS with master...
I20260811 11:49:19.601141 13141 heartbeater.cc:511] Master 127.20.244.126:45699 requested a full tablet report, sending...
I20260811 11:49:19.603114 12919 ts_manager.cc:194] Registered new tserver with Master: e39d712b98c9439283ea686de872b921 (127.20.244.65:34335)
I20260811 11:49:19.604940 12919 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.244.65:43881
W20260811 11:49:19.716361 13144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:19.716694 13144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:19.716737 13144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:19.721372 13144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:19.721436 13144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:19.721499 13144 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.66
I20260811 11:49:19.726531 13144 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:34769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.244.66
--webserver_port=0
--tserver_master_addrs=127.20.244.126:45699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13144
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.66
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:19.727599 13144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:19.729395 13144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:19.739499 13150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:19.739714 13144 server_base.cc:1034] running on GCE node
W20260811 11:49:19.739493 13152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:19.739500 13149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:19.740270 13144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:19.740940 13144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:19.742156 13144 hybrid_clock.cc:648] HybridClock initialized: now 1786448959742130 us; error 42 us; skew 500 ppm
I20260811 11:49:19.744129 13144 webserver.cc:460] Webserver started at http://127.20.244.66:39015/ using document root <none> and password file <none>
I20260811 11:49:19.744732 13144 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:19.744829 13144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:19.745075 13144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:19.747269 13144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-1/data/instance:
uuid: "c905072159324e0d9da28e02e828b49d"
format_stamp: "Formatted at 2026-08-11 11:49:19 on dist-test-slave-vkjp"
server_key: "d93d631932c75f8432530e01e3a5d962"
server_key_iv: "85d3915a1d144a4758b0ac2147dc0622"
server_key_version: "encryptionkey@0"
I20260811 11:49:19.747874 13144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance:
uuid: "c905072159324e0d9da28e02e828b49d"
format_stamp: "Formatted at 2026-08-11 11:49:19 on dist-test-slave-vkjp"
server_key: "d93d631932c75f8432530e01e3a5d962"
server_key_iv: "85d3915a1d144a4758b0ac2147dc0622"
server_key_version: "encryptionkey@0"
I20260811 11:49:19.751852 13144 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 11:49:19.754428 13158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:19.755730 13144 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:49:19.755877 13144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-1/wal
uuid: "c905072159324e0d9da28e02e828b49d"
format_stamp: "Formatted at 2026-08-11 11:49:19 on dist-test-slave-vkjp"
server_key: "d93d631932c75f8432530e01e3a5d962"
server_key_iv: "85d3915a1d144a4758b0ac2147dc0622"
server_key_version: "encryptionkey@0"
I20260811 11:49:19.756001 13144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:19.774102 13144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:19.774875 13144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:19.775152 13144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:19.775847 13144 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:49:19.776867 13144 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:49:19.776943 13144 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:19.777014 13144 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:49:19.777057 13144 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:19.786988 13144 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.66:38499
I20260811 11:49:19.787045 13291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.66:38499 every 8 connection(s)
I20260811 11:49:19.787983 13144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-1/data/info.pb
I20260811 11:49:19.792734 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 13144
I20260811 11:49:19.792887 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-1/wal/instance
I20260811 11:49:19.793244 21457 external_mini_cluster.cc:1428] Setting key f317493318ed75ae1879242bc98ff348
I20260811 11:49:19.795375 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.244.67:0
--local_ip_for_outbound_sockets=127.20.244.67
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:45699
--builtin_ntp_servers=127.20.244.84:34769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 11:49:19.798313 12964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:19.789813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.66:39325 (local address 127.20.244.126:45699)
0811 11:49:19.789977 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:19.789981 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:19.790997 (+ 1016us) server_negotiation.cc:407] Connection header received
0811 11:49:19.792352 (+ 1355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:19.792354 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:19.792420 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:19.792486 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:19.793743 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:19.794581 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:19.796109 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:19.796367 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:19.796530 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:19.797826 (+ 1296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:19.797829 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:19.797832 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:19.797845 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:19.797867 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:19.797875 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:19.797936 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:19.798144 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 11:49:19.798198 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 11:49:19.799808 13294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:19.790168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:45699 (local address 127.20.244.66:39325)
0811 11:49:19.790813 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:19.790861 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:19.792158 (+ 1297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:19.792730 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:19.792739 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:19.792856 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:19.793568 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:19.793588 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:19.794711 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:19.794715 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:19.795960 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:19.795971 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:19.796577 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:19.796581 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:19.796762 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:19.797472 (+ 710us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:49:19.797475 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:19.797540 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:49:19.797639 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:19.797967 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:19.797977 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:19.797984 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 11:49:19.798133 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 11:49:19.798610 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":115,"threads_started":1}
I20260811 11:49:19.801108 13292 heartbeater.cc:347] Connected to a master server at 127.20.244.126:45699
I20260811 11:49:19.801357 13292 heartbeater.cc:464] Registering TS with master...
I20260811 11:49:19.801882 13292 heartbeater.cc:511] Master 127.20.244.126:45699 requested a full tablet report, sending...
I20260811 11:49:19.802997 12919 ts_manager.cc:194] Registered new tserver with Master: c905072159324e0d9da28e02e828b49d (127.20.244.66:38499)
I20260811 11:49:19.803625 12919 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.244.66:39325
W20260811 11:49:19.921366 13295 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:19.921981 13295 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:19.922093 13295 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:19.926370 13295 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:19.926465 13295 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:19.926554 13295 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.244.67
I20260811 11:49:19.931484 13295 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:34769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.244.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.244.67
--webserver_port=0
--tserver_master_addrs=127.20.244.126:45699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13295
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.244.67
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:19.932705 13295 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:19.934311 13295 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:19.944764 13300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:19.944890 13295 server_base.cc:1034] running on GCE node
W20260811 11:49:19.944756 13301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:19.944756 13303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:19.945634 13295 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:19.946376 13295 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:19.947546 13295 hybrid_clock.cc:648] HybridClock initialized: now 1786448959947524 us; error 33 us; skew 500 ppm
I20260811 11:49:19.949685 13295 webserver.cc:460] Webserver started at http://127.20.244.67:45105/ using document root <none> and password file <none>
I20260811 11:49:19.950331 13295 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:19.950500 13295 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:19.950762 13295 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:19.953361 13295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-2/data/instance:
uuid: "0a49ee43787e4c92bd96e2a89d9a1ee6"
format_stamp: "Formatted at 2026-08-11 11:49:19 on dist-test-slave-vkjp"
server_key: "a23b474dcc4c906facf1266238389eee"
server_key_iv: "ca03ed83137958f892045b7f0dba07c3"
server_key_version: "encryptionkey@0"
I20260811 11:49:19.953984 13295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance:
uuid: "0a49ee43787e4c92bd96e2a89d9a1ee6"
format_stamp: "Formatted at 2026-08-11 11:49:19 on dist-test-slave-vkjp"
server_key: "a23b474dcc4c906facf1266238389eee"
server_key_iv: "ca03ed83137958f892045b7f0dba07c3"
server_key_version: "encryptionkey@0"
I20260811 11:49:19.958010 13295 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 11:49:19.960757 13309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:19.962209 13295 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 11:49:19.962358 13295 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-2/wal
uuid: "0a49ee43787e4c92bd96e2a89d9a1ee6"
format_stamp: "Formatted at 2026-08-11 11:49:19 on dist-test-slave-vkjp"
server_key: "a23b474dcc4c906facf1266238389eee"
server_key_iv: "ca03ed83137958f892045b7f0dba07c3"
server_key_version: "encryptionkey@0"
I20260811 11:49:19.962483 13295 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:19.974723 13295 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:19.975564 13295 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:19.975776 13295 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:19.976435 13295 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:49:19.977423 13295 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:49:19.977495 13295 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:19.977571 13295 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:49:19.977614 13295 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:19.987164 13295 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.67:35397
I20260811 11:49:19.987200 13438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.67:35397 every 8 connection(s)
I20260811 11:49:19.988188 13295 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-2/data/info.pb
I20260811 11:49:19.994499 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 13295
I20260811 11:49:19.994616 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-2/wal/instance
I20260811 11:49:19.994897 21457 external_mini_cluster.cc:1428] Setting key 88116d67e666ba4586db0c481212b4c4
I20260811 11:49:19.998191 12964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:19.990140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:39569 (local address 127.20.244.126:45699)
0811 11:49:19.990283 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:19.990287 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:19.991410 (+ 1123us) server_negotiation.cc:407] Connection header received
0811 11:49:19.992918 (+ 1508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:19.992921 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:19.992992 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:19.993102 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:19.994090 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:19.994889 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:19.996222 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:19.996475 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:19.996559 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:19.997779 (+ 1220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:19.997782 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:19.997785 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:19.997796 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:19.997816 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:19.997824 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:19.997884 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:19.998026 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 11:49:19.998078 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 11:49:19.999172 13441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:19.990545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:45699 (local address 127.20.244.67:39569)
0811 11:49:19.991264 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:19.991305 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:19.992704 (+ 1399us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:19.993299 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:19.993306 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:19.993390 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:19.993936 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:19.993951 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:19.995048 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:19.995052 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:19.996113 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:19.996123 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:19.996626 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:19.996631 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:19.996826 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:19.997539 (+ 713us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:49:19.997540 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:19.997581 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:49:19.997645 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:19.997901 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:19.997907 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:19.997911 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:49:19.998007 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 11:49:19.998226 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":119,"threads_started":1}
I20260811 11:49:20.000332 13439 heartbeater.cc:347] Connected to a master server at 127.20.244.126:45699
I20260811 11:49:20.000600 13439 heartbeater.cc:464] Registering TS with master...
I20260811 11:49:20.001144 13439 heartbeater.cc:511] Master 127.20.244.126:45699 requested a full tablet report, sending...
I20260811 11:49:20.002153 12919 ts_manager.cc:194] Registered new tserver with Master: 0a49ee43787e4c92bd96e2a89d9a1ee6 (127.20.244.67:35397)
I20260811 11:49:20.002880 12919 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.244.67:39569
I20260811 11:49:20.008983 21457 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:49:20.018204 12964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:20.010955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59238 (local address 127.20.244.126:45699)
0811 11:49:20.011123 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:20.011128 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:20.011315 (+ 187us) server_negotiation.cc:407] Connection header received
0811 11:49:20.011441 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:20.011443 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:20.011485 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:20.011542 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:20.011787 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.012280 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.013080 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.013284 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.013357 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:20.017658 (+ 4301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:20.017662 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:20.017664 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:20.017677 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:20.017698 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:20.017706 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:20.017769 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:20.017945 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 11:49:20.018016 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 11:49:20.021248 12919 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59238:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:49:20.024343 12919 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:49:20.038985 13457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:20.033875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46448 (local address 127.20.244.65:34335)
0811 11:49:20.034304 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:20.034320 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:20.034764 (+ 444us) server_negotiation.cc:407] Connection header received
0811 11:49:20.034855 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:20.034860 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:20.035027 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:20.035191 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:20.035379 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.036282 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.037769 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.038308 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.038437 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:20.038662 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:20.038720 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 11:49:20.038814 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":123,"threads_started":1}
I20260811 11:49:20.039156 13452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:20.032692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:38499 (local address 127.0.0.1:34034)
0811 11:49:20.033073 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:20.033127 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:20.033263 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:20.034102 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:20.034108 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:20.034133 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:20.034285 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:20.034292 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.035921 (+ 1629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.035924 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:20.037537 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:20.037549 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.038677 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.038685 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:20.038790 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:20.038818 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 11:49:20.038874 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 11:49:20.038945 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":145,"thread_start_us":100,"threads_started":1}
I20260811 11:49:20.039443 13454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:20.033092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.67:35397 (local address 127.0.0.1:39186)
0811 11:49:20.033507 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:20.033522 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:20.033612 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:20.034325 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:20.034329 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:20.034347 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:20.034454 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:20.034461 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.035816 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.035819 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:20.037551 (+ 1732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:20.037557 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.038899 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.038902 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:20.038980 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:20.038999 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 11:49:20.039045 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 11:49:20.039314 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"mutex_wait_us":204,"thread_start_us":96,"threads_started":1}
I20260811 11:49:20.038992 13455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:20.033451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:34335 (local address 127.0.0.1:46448)
0811 11:49:20.034652 (+ 1201us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:20.034665 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:20.034759 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:20.035188 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:20.035191 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:20.035210 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:20.035285 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:20.035291 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.036402 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.036406 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:20.037594 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:20.037637 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.038438 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.038441 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:20.038548 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:20.038585 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 11:49:20.038690 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 11:49:20.038811 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1141,"mutex_wait_us":88,"thread_start_us":101,"threads_started":1}
I20260811 11:49:20.039634 13453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:20.032893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34034 (local address 127.20.244.66:38499)
0811 11:49:20.033559 (+ 666us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:20.033573 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:20.033600 (+ 27us) server_negotiation.cc:407] Connection header received
0811 11:49:20.033680 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:20.033686 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:20.033906 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:20.034454 (+ 548us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:20.034603 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.035783 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.037688 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.038522 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.039075 (+ 553us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:20.039307 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:20.039359 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 11:49:20.039448 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":136,"threads_started":1}
I20260811 11:49:20.041080 13456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:20.033433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39186 (local address 127.20.244.67:35397)
0811 11:49:20.033853 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:20.033865 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:20.033887 (+ 22us) server_negotiation.cc:407] Connection header received
0811 11:49:20.033962 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:20.033967 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:20.034171 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:20.034608 (+ 437us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:20.034759 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.035700 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.037807 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.038649 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.040566 (+ 1917us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:20.040738 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:20.040801 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 11:49:20.040900 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":163,"threads_started":1}
I20260811 11:49:20.042531 13064 tablet_service.cc:1467] Processing CreateTablet for tablet 6bbfb9fdd1e346d4937f9ac945a1fb40 (DEFAULT_TABLE table=test-table [id=1912d02f9475438f8178dbb5d0f80c48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:49:20.042677 13211 tablet_service.cc:1467] Processing CreateTablet for tablet 6bbfb9fdd1e346d4937f9ac945a1fb40 (DEFAULT_TABLE table=test-table [id=1912d02f9475438f8178dbb5d0f80c48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:49:20.043639 13064 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bbfb9fdd1e346d4937f9ac945a1fb40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:20.043733 13211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bbfb9fdd1e346d4937f9ac945a1fb40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:20.043799 13364 tablet_service.cc:1467] Processing CreateTablet for tablet 6bbfb9fdd1e346d4937f9ac945a1fb40 (DEFAULT_TABLE table=test-table [id=1912d02f9475438f8178dbb5d0f80c48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:49:20.044775 13364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bbfb9fdd1e346d4937f9ac945a1fb40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:20.050959 13458 tablet_bootstrap.cc:492] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P e39d712b98c9439283ea686de872b921: Bootstrap starting.
I20260811 11:49:20.051542 13461 tablet_bootstrap.cc:492] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6: Bootstrap starting.
I20260811 11:49:20.052084 13460 tablet_bootstrap.cc:492] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P c905072159324e0d9da28e02e828b49d: Bootstrap starting.
I20260811 11:49:20.053442 13458 tablet_bootstrap.cc:654] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P e39d712b98c9439283ea686de872b921: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:20.053825 13461 tablet_bootstrap.cc:654] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:20.053916 13460 tablet_bootstrap.cc:654] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P c905072159324e0d9da28e02e828b49d: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:20.054399 13458 log.cc:824] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P e39d712b98c9439283ea686de872b921: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:20.054596 13461 log.cc:824] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:20.054760 13460 log.cc:824] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P c905072159324e0d9da28e02e828b49d: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:20.056912 13460 tablet_bootstrap.cc:492] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P c905072159324e0d9da28e02e828b49d: No bootstrap required, opened a new log
I20260811 11:49:20.056912 13458 tablet_bootstrap.cc:492] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P e39d712b98c9439283ea686de872b921: No bootstrap required, opened a new log
I20260811 11:49:20.057130 13460 ts_tablet_manager.cc:1397] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P c905072159324e0d9da28e02e828b49d: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260811 11:49:20.057130 13458 ts_tablet_manager.cc:1397] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P e39d712b98c9439283ea686de872b921: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 11:49:20.060762 13461 tablet_bootstrap.cc:492] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6: No bootstrap required, opened a new log
I20260811 11:49:20.061041 13461 ts_tablet_manager.cc:1397] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260811 11:49:20.061879 13460 raft_consensus.cc:348] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P c905072159324e0d9da28e02e828b49d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c905072159324e0d9da28e02e828b49d" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38499 } } peers { permanent_uuid: "e39d712b98c9439283ea686de872b921" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34335 } } peers { permanent_uuid: "0a49ee43787e4c92bd96e2a89d9a1ee6" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35397 } }
I20260811 11:49:20.061879 13458 raft_consensus.cc:348] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P e39d712b98c9439283ea686de872b921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c905072159324e0d9da28e02e828b49d" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38499 } } peers { permanent_uuid: "e39d712b98c9439283ea686de872b921" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34335 } } peers { permanent_uuid: "0a49ee43787e4c92bd96e2a89d9a1ee6" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35397 } }
I20260811 11:49:20.062175 13458 raft_consensus.cc:374] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P e39d712b98c9439283ea686de872b921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:20.062175 13460 raft_consensus.cc:374] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P c905072159324e0d9da28e02e828b49d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:20.062237 13460 raft_consensus.cc:729] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P c905072159324e0d9da28e02e828b49d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c905072159324e0d9da28e02e828b49d, State: Initialized, Role: FOLLOWER
I20260811 11:49:20.062248 13458 raft_consensus.cc:729] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P e39d712b98c9439283ea686de872b921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e39d712b98c9439283ea686de872b921, State: Initialized, Role: FOLLOWER
I20260811 11:49:20.062712 13460 consensus_queue.cc:260] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P c905072159324e0d9da28e02e828b49d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c905072159324e0d9da28e02e828b49d" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38499 } } peers { permanent_uuid: "e39d712b98c9439283ea686de872b921" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34335 } } peers { permanent_uuid: "0a49ee43787e4c92bd96e2a89d9a1ee6" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35397 } }
I20260811 11:49:20.062712 13458 consensus_queue.cc:260] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P e39d712b98c9439283ea686de872b921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c905072159324e0d9da28e02e828b49d" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38499 } } peers { permanent_uuid: "e39d712b98c9439283ea686de872b921" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34335 } } peers { permanent_uuid: "0a49ee43787e4c92bd96e2a89d9a1ee6" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35397 } }
I20260811 11:49:20.063764 13292 heartbeater.cc:503] Master 127.20.244.126:45699 was elected leader, sending a full tablet report...
I20260811 11:49:20.063831 13458 ts_tablet_manager.cc:1428] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P e39d712b98c9439283ea686de872b921: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260811 11:49:20.064101 13141 heartbeater.cc:503] Master 127.20.244.126:45699 was elected leader, sending a full tablet report...
I20260811 11:49:20.064985 13460 ts_tablet_manager.cc:1428] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P c905072159324e0d9da28e02e828b49d: Time spent starting tablet: real 0.008s user 0.006s sys 0.002s
I20260811 11:49:20.066850 13461 raft_consensus.cc:348] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c905072159324e0d9da28e02e828b49d" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38499 } } peers { permanent_uuid: "e39d712b98c9439283ea686de872b921" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34335 } } peers { permanent_uuid: "0a49ee43787e4c92bd96e2a89d9a1ee6" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35397 } }
I20260811 11:49:20.067195 13461 raft_consensus.cc:374] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:20.067340 13461 raft_consensus.cc:729] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a49ee43787e4c92bd96e2a89d9a1ee6, State: Initialized, Role: FOLLOWER
I20260811 11:49:20.067858 13461 consensus_queue.cc:260] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c905072159324e0d9da28e02e828b49d" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38499 } } peers { permanent_uuid: "e39d712b98c9439283ea686de872b921" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34335 } } peers { permanent_uuid: "0a49ee43787e4c92bd96e2a89d9a1ee6" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35397 } }
I20260811 11:49:20.068598 13439 heartbeater.cc:503] Master 127.20.244.126:45699 was elected leader, sending a full tablet report...
I20260811 11:49:20.068905 13461 ts_tablet_manager.cc:1428] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6: Time spent starting tablet: real 0.008s user 0.000s sys 0.005s
W20260811 11:49:20.084942 13142 tablet.cc:2369] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P e39d712b98c9439283ea686de872b921: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:49:20.097163 13469 raft_consensus.cc:482] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:49:20.097358 13469 raft_consensus.cc:504] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c905072159324e0d9da28e02e828b49d" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38499 } } peers { permanent_uuid: "e39d712b98c9439283ea686de872b921" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34335 } } peers { permanent_uuid: "0a49ee43787e4c92bd96e2a89d9a1ee6" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35397 } }
I20260811 11:49:20.098639 13469 leader_election.cc:288] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c905072159324e0d9da28e02e828b49d (127.20.244.66:38499), e39d712b98c9439283ea686de872b921 (127.20.244.65:34335)
I20260811 11:49:20.102334 13453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:20.098992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:49555 (local address 127.20.244.66:38499)
0811 11:49:20.099161 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:20.099167 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:20.099188 (+ 21us) server_negotiation.cc:407] Connection header received
0811 11:49:20.099251 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:20.099254 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:20.099310 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:20.099433 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:20.099749 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.100273 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.101360 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.101767 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.101908 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:20.101959 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:20.102140 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 11:49:20.102205 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 11:49:20.102334 13441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:20.098855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.66:38499 (local address 127.20.244.67:49555)
0811 11:49:20.098977 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:20.098995 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:20.099120 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:20.099449 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:20.099469 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:20.099491 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:20.099624 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:20.099632 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.100422 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.100425 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:20.101223 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:20.101232 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.101903 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.101907 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:20.102007 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:20.102028 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 11:49:20.102121 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 11:49:20.102197 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 11:49:20.102844 13470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:20.099178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:34335 (local address 127.20.244.67:37917)
0811 11:49:20.099673 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:20.099694 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:20.099812 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:20.100080 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:20.100082 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:20.100099 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:49:20.100215 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:20.100220 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.100931 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.100935 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:20.101694 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:20.101703 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.102378 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.102381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:20.102498 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:20.102531 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 11:49:20.102617 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 11:49:20.102694 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":170,"threads_started":1}
I20260811 11:49:20.102865 13457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:20.099271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.244.67:37917 (local address 127.20.244.65:34335)
0811 11:49:20.099449 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:20.099453 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:20.099775 (+ 322us) server_negotiation.cc:407] Connection header received
0811 11:49:20.099922 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:20.099926 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:20.099980 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:20.100066 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:49:20.100329 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.100813 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.101825 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.102231 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.102370 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:20.102416 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:20.102654 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 11:49:20.102728 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 11:49:20.103312 13234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bbfb9fdd1e346d4937f9ac945a1fb40" candidate_uuid: "0a49ee43787e4c92bd96e2a89d9a1ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c905072159324e0d9da28e02e828b49d" is_pre_election: true
I20260811 11:49:20.103555 13086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bbfb9fdd1e346d4937f9ac945a1fb40" candidate_uuid: "0a49ee43787e4c92bd96e2a89d9a1ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39d712b98c9439283ea686de872b921" is_pre_election: true
I20260811 11:49:20.103645 13234 raft_consensus.cc:2454] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P c905072159324e0d9da28e02e828b49d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a49ee43787e4c92bd96e2a89d9a1ee6 in term 0.
I20260811 11:49:20.103842 13086 raft_consensus.cc:2454] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P e39d712b98c9439283ea686de872b921 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a49ee43787e4c92bd96e2a89d9a1ee6 in term 0.
I20260811 11:49:20.104153 13312 leader_election.cc:302] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a49ee43787e4c92bd96e2a89d9a1ee6, c905072159324e0d9da28e02e828b49d; no voters:
I20260811 11:49:20.104423 13469 raft_consensus.cc:2781] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:49:20.104502 13469 raft_consensus.cc:482] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:49:20.104534 13469 raft_consensus.cc:3037] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:20.105576 13469 raft_consensus.cc:504] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c905072159324e0d9da28e02e828b49d" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38499 } } peers { permanent_uuid: "e39d712b98c9439283ea686de872b921" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34335 } } peers { permanent_uuid: "0a49ee43787e4c92bd96e2a89d9a1ee6" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35397 } }
I20260811 11:49:20.105923 13469 leader_election.cc:288] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6 [CANDIDATE]: Term 1 election: Requested vote from peers c905072159324e0d9da28e02e828b49d (127.20.244.66:38499), e39d712b98c9439283ea686de872b921 (127.20.244.65:34335)
I20260811 11:49:20.106383 13234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bbfb9fdd1e346d4937f9ac945a1fb40" candidate_uuid: "0a49ee43787e4c92bd96e2a89d9a1ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c905072159324e0d9da28e02e828b49d"
I20260811 11:49:20.106382 13086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bbfb9fdd1e346d4937f9ac945a1fb40" candidate_uuid: "0a49ee43787e4c92bd96e2a89d9a1ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39d712b98c9439283ea686de872b921"
I20260811 11:49:20.106518 13234 raft_consensus.cc:3037] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P c905072159324e0d9da28e02e828b49d [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:20.106518 13086 raft_consensus.cc:3037] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P e39d712b98c9439283ea686de872b921 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:20.107899 13234 raft_consensus.cc:2454] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P c905072159324e0d9da28e02e828b49d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a49ee43787e4c92bd96e2a89d9a1ee6 in term 1.
I20260811 11:49:20.107899 13086 raft_consensus.cc:2454] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P e39d712b98c9439283ea686de872b921 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a49ee43787e4c92bd96e2a89d9a1ee6 in term 1.
I20260811 11:49:20.108208 13312 leader_election.cc:302] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a49ee43787e4c92bd96e2a89d9a1ee6, e39d712b98c9439283ea686de872b921; no voters:
I20260811 11:49:20.108385 13469 raft_consensus.cc:2781] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:20.108623 13469 raft_consensus.cc:686] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6 [term 1 LEADER]: Becoming Leader. State: Replica: 0a49ee43787e4c92bd96e2a89d9a1ee6, State: Running, Role: LEADER
I20260811 11:49:20.108978 13469 consensus_queue.cc:237] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c905072159324e0d9da28e02e828b49d" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38499 } } peers { permanent_uuid: "e39d712b98c9439283ea686de872b921" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34335 } } peers { permanent_uuid: "0a49ee43787e4c92bd96e2a89d9a1ee6" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35397 } }
I20260811 11:49:20.112382 12918 catalog_manager.cc:5495] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a49ee43787e4c92bd96e2a89d9a1ee6 (127.20.244.67). New cstate: current_term: 1 leader_uuid: "0a49ee43787e4c92bd96e2a89d9a1ee6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c905072159324e0d9da28e02e828b49d" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39d712b98c9439283ea686de872b921" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a49ee43787e4c92bd96e2a89d9a1ee6" member_type: VOTER last_known_addr { host: "127.20.244.67" port: 35397 } health_report { overall_health: HEALTHY } } }
I20260811 11:49:20.140426 13456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:20.136595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39200 (local address 127.20.244.67:35397)
0811 11:49:20.136758 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:20.136763 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:20.136777 (+ 14us) server_negotiation.cc:407] Connection header received
0811 11:49:20.136973 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:20.136977 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:20.137037 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:20.137159 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:49:20.137432 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.137970 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.138857 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:20.139106 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:20.139221 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:20.139566 (+ 345us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:49:20.140011 (+ 445us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:49:20.140153 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:20.140220 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 11:49:20.140277 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 11:49:20.146891 13234 raft_consensus.cc:1261] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P c905072159324e0d9da28e02e828b49d [term 1 FOLLOWER]: Refusing update from remote peer 0a49ee43787e4c92bd96e2a89d9a1ee6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:49:20.146890 13086 raft_consensus.cc:1261] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P e39d712b98c9439283ea686de872b921 [term 1 FOLLOWER]: Refusing update from remote peer 0a49ee43787e4c92bd96e2a89d9a1ee6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:49:20.147713 13471 consensus_queue.cc:1035] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e39d712b98c9439283ea686de872b921" member_type: VOTER last_known_addr { host: "127.20.244.65" port: 34335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:49:20.147960 13469 consensus_queue.cc:1035] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c905072159324e0d9da28e02e828b49d" member_type: VOTER last_known_addr { host: "127.20.244.66" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:49:20.165890 12917 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59238:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:49:20.166082 12917 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59238:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:49:20.168859 12917 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 46370b8353b849dc97b859ef210dc589: Sending DeleteTablet for 3 replicas of tablet 6bbfb9fdd1e346d4937f9ac945a1fb40
I20260811 11:49:20.169868 13364 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bbfb9fdd1e346d4937f9ac945a1fb40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:49:20 UTC) from {username='slave'} at 127.0.0.1:39186
I20260811 11:49:20.169945 13211 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bbfb9fdd1e346d4937f9ac945a1fb40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:49:20 UTC) from {username='slave'} at 127.0.0.1:34034
I20260811 11:49:20.170482 13485 tablet_replica.cc:330] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6: stopping tablet replica
I20260811 11:49:20.170490 13064 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bbfb9fdd1e346d4937f9ac945a1fb40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:49:20 UTC) from {username='slave'} at 127.0.0.1:46448
I20260811 11:49:20.170956 13485 raft_consensus.cc:2229] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:49:20.171036 13487 tablet_replica.cc:330] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P e39d712b98c9439283ea686de872b921: stopping tablet replica
I20260811 11:49:20.171310 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 12993
I20260811 11:49:20.171397 13487 raft_consensus.cc:2229] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P e39d712b98c9439283ea686de872b921 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:49:20.178804 13486 tablet_replica.cc:330] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P c905072159324e0d9da28e02e828b49d: stopping tablet replica
I20260811 11:49:20.179224 13486 raft_consensus.cc:2229] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P c905072159324e0d9da28e02e828b49d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:49:20.179610 13486 raft_consensus.cc:2258] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P c905072159324e0d9da28e02e828b49d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:49:20.181260 13486 ts_tablet_manager.cc:1905] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P c905072159324e0d9da28e02e828b49d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:49:20.184155 13486 ts_tablet_manager.cc:1918] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P c905072159324e0d9da28e02e828b49d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:49:20.184285 13486 log.cc:1196] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P c905072159324e0d9da28e02e828b49d: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-1/wal/wals/6bbfb9fdd1e346d4937f9ac945a1fb40
I20260811 11:49:20.184639 13486 ts_tablet_manager.cc:1939] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P c905072159324e0d9da28e02e828b49d: Deleting consensus metadata
I20260811 11:49:20.186213 12902 catalog_manager.cc:4841] TS c905072159324e0d9da28e02e828b49d (127.20.244.66:38499): tablet 6bbfb9fdd1e346d4937f9ac945a1fb40 (table test-table [id=1912d02f9475438f8178dbb5d0f80c48]) successfully deleted
I20260811 11:49:20.187865 13485 raft_consensus.cc:2258] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:49:20.189690 13485 ts_tablet_manager.cc:1905] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 11:49:20.190934 12902 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.244.65:34335 (error 108)
I20260811 11:49:20.192185 13454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:20.191828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.65:34335 (local address 127.0.0.1:46450)
0811 11:49:20.191978 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:20.192067 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.65:34335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 11:49:20.192371 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 13144
I20260811 11:49:20.192739 13485 ts_tablet_manager.cc:1918] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:49:20.192843 13485 log.cc:1196] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6: Deleting WAL directory at /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786448696706302-21457-0/minicluster-data/ts-2/wal/wals/6bbfb9fdd1e346d4937f9ac945a1fb40
I20260811 11:49:20.193231 13485 ts_tablet_manager.cc:1939] T 6bbfb9fdd1e346d4937f9ac945a1fb40 P 0a49ee43787e4c92bd96e2a89d9a1ee6: Deleting consensus metadata
I20260811 11:49:20.194685 12903 catalog_manager.cc:4841] TS 0a49ee43787e4c92bd96e2a89d9a1ee6 (127.20.244.67:35397): tablet 6bbfb9fdd1e346d4937f9ac945a1fb40 (table test-table [id=1912d02f9475438f8178dbb5d0f80c48]) successfully deleted
W20260811 11:49:20.195500 12902 catalog_manager.cc:4584] TS e39d712b98c9439283ea686de872b921 (127.20.244.65:34335): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6bbfb9fdd1e346d4937f9ac945a1fb40: Network error: Client connection negotiation failed: client connection to 127.20.244.65:34335: connect: Connection refused (error 111)
I20260811 11:49:20.201581 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 13295
I20260811 11:49:20.211462 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 12880
2026-08-11T11:49:20Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1122 ms)
[----------] 6 tests from EncryptionPolicyTest (11699 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:20 dist-test-slave-vkjp krb5kdc[13495](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:20 dist-test-slave-vkjp krb5kdc[13495](info): set up 2 sockets
Aug 11 11:49:20 dist-test-slave-vkjp krb5kdc[13495](info): commencing operation
krb5kdc: starting...
W20260811 11:49:21.371784 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:21 dist-test-slave-vkjp krb5kdc[13495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448961, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:49:21.510643 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41529
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41529
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:21.630172 13511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:21.630510 13511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:21.630589 13511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:21.634770 13511 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:21.634877 13511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:21.634917 13511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:21.634958 13511 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:21.635044 13511 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:21.640888 13511 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41529
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:21.642143 13511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:21.643282 13511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:21.652522 13517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:21.652508 13519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:21.652575 13511 server_base.cc:1034] running on GCE node
W20260811 11:49:21.652503 13521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:21.653323 13511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:21.654563 13511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:21.655771 13511 hybrid_clock.cc:648] HybridClock initialized: now 1786448961655738 us; error 48 us; skew 500 ppm
Aug 11 11:49:21 dist-test-slave-vkjp krb5kdc[13495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448961, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:21.658743 13511 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:49:21.659770 13511 webserver.cc:460] Webserver started at http://127.0.0.1:40385/ using document root <none> and password file <none>
I20260811 11:49:21.660353 13511 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:21.660456 13511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:21.660698 13511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:21.662937 13511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "b1a9f0c7f0404ad6b5dfc58b9ec4b8fd"
format_stamp: "Formatted at 2026-08-11 11:49:21 on dist-test-slave-vkjp"
server_key: "a8b9c72fae6f0ca785f3443435a2e869"
server_key_iv: "0cfa06455c373866050d1de02a50adf8"
server_key_version: "encryptionkey@0"
I20260811 11:49:21.663604 13511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "b1a9f0c7f0404ad6b5dfc58b9ec4b8fd"
format_stamp: "Formatted at 2026-08-11 11:49:21 on dist-test-slave-vkjp"
server_key: "a8b9c72fae6f0ca785f3443435a2e869"
server_key_iv: "0cfa06455c373866050d1de02a50adf8"
server_key_version: "encryptionkey@0"
I20260811 11:49:21.667500 13511 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 11:49:21.669966 13530 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:21.671334 13511 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:49:21.671494 13511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "b1a9f0c7f0404ad6b5dfc58b9ec4b8fd"
format_stamp: "Formatted at 2026-08-11 11:49:21 on dist-test-slave-vkjp"
server_key: "a8b9c72fae6f0ca785f3443435a2e869"
server_key_iv: "0cfa06455c373866050d1de02a50adf8"
server_key_version: "encryptionkey@0"
I20260811 11:49:21.671617 13511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:21.685642 13511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:21.689091 13511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:21.689307 13511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:21.696750 13511 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41529
I20260811 11:49:21.696777 13588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41529 every 8 connection(s)
I20260811 11:49:21.697718 13511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:21.698897 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 13511
I20260811 11:49:21.699088 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:21.699427 21457 external_mini_cluster.cc:1428] Setting key 8293ed058445268dafd96e1e1f88c243
I20260811 11:49:21.700942 13589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:21.706538 13589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd: Bootstrap starting.
Aug 11 11:49:21 dist-test-slave-vkjp krb5kdc[13495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448961, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 11:49:21.708881 13589 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:21.709642 13589 log.cc:824] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:21.711889 13589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd: No bootstrap required, opened a new log
I20260811 11:49:21.714641 13593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:21.700978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60067 (local address 127.0.0.1:41529)
0811 11:49:21.701455 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:21.701471 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:21.701507 (+ 36us) server_negotiation.cc:407] Connection header received
0811 11:49:21.702158 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:21.702174 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:21.702506 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:21.702844 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:21.703730 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:21.704730 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:21.705601 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:21.706085 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:21.706397 (+ 312us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:21.709084 (+ 2687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:21.709089 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:21.709102 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:21.709130 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:21.711350 (+ 2220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:21.711968 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:21.711980 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:21.712006 (+ 26us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:21.712156 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:21.712559 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:21.712562 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:21.712564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:21.713000 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:21.713254 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:21.713617 (+ 363us) server_negotiation.cc:299] Negotiation successful
0811 11:49:21.713875 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":136,"threads_started":1}
I20260811 11:49:21.715716 13589 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a9f0c7f0404ad6b5dfc58b9ec4b8fd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41529 } }
I20260811 11:49:21.715972 13589 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:21.716053 13589 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a9f0c7f0404ad6b5dfc58b9ec4b8fd, State: Initialized, Role: FOLLOWER
I20260811 11:49:21.716518 13589 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a9f0c7f0404ad6b5dfc58b9ec4b8fd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41529 } }
I20260811 11:49:21.716676 13589 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:21.716748 13589 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:21.716888 13589 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:21.717918 13589 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a9f0c7f0404ad6b5dfc58b9ec4b8fd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41529 } }
I20260811 11:49:21.717972 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:49:21.718264 13589 leader_election.cc:302] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1a9f0c7f0404ad6b5dfc58b9ec4b8fd; no voters:
I20260811 11:49:21.718595 13589 leader_election.cc:288] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:21.718721 13595 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:21.718967 13595 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd [term 1 LEADER]: Becoming Leader. State: Replica: b1a9f0c7f0404ad6b5dfc58b9ec4b8fd, State: Running, Role: LEADER
I20260811 11:49:21.719324 13595 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a9f0c7f0404ad6b5dfc58b9ec4b8fd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41529 } }
I20260811 11:49:21.720048 13589 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:21.720685 13597 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1a9f0c7f0404ad6b5dfc58b9ec4b8fd. Latest consensus state: current_term: 1 leader_uuid: "b1a9f0c7f0404ad6b5dfc58b9ec4b8fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a9f0c7f0404ad6b5dfc58b9ec4b8fd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41529 } } }
I20260811 11:49:21.720835 13597 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:21.721398 13596 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1a9f0c7f0404ad6b5dfc58b9ec4b8fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a9f0c7f0404ad6b5dfc58b9ec4b8fd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41529 } } }
I20260811 11:49:21.721510 13596 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:21.722923 13620 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:21.727542 13620 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:21.731580 13593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:21.720372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52113 (local address 127.0.0.1:41529)
0811 11:49:21.720472 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:21.720476 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:21.721355 (+ 879us) server_negotiation.cc:407] Connection header received
0811 11:49:21.721554 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:21.721557 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:21.721608 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:21.721666 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:21.722627 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:21.723375 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:21.724695 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:21.724953 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:21.725044 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:21.727128 (+ 2084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:21.727133 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:21.727137 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:21.727166 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:21.729047 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:21.729903 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:21.729906 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:21.729907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:21.729994 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:21.730468 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:21.730472 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:21.730474 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:21.730682 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:21.730863 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:21.731221 (+ 358us) server_negotiation.cc:299] Negotiation successful
0811 11:49:21.731380 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 11:49:21.734634 13620 catalog_manager.cc:1347] Generated new cluster ID: 00c895b266234550acb36a18a0c3d247
I20260811 11:49:21.734710 13620 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:21.744772 13620 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:21.746105 13620 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:21.752225 13620 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1a9f0c7f0404ad6b5dfc58b9ec4b8fd: Generated new TSK 0
I20260811 11:49:21.753062 13620 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:49:21.761051 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 13511
W20260811 11:49:21.772172 13489 connection.cc:535] client connection to 127.0.0.1:41529 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41529): Connection reset by peer (error 104)
2026-08-11T11:49:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1548 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:21 dist-test-slave-vkjp krb5kdc[13627](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:21 dist-test-slave-vkjp krb5kdc[13627](info): set up 2 sockets
Aug 11 11:49:21 dist-test-slave-vkjp krb5kdc[13627](info): commencing operation
krb5kdc: starting...
W20260811 11:49:22.940339 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:23 dist-test-slave-vkjp krb5kdc[13627](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448963, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:49:23.079900 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35413
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35413
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:23.198324 13644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:23.198644 13644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:23.198688 13644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:23.202939 13644 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:23.203023 13644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:23.203044 13644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:23.203061 13644 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:23.203095 13644 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:23.208835 13644 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35413
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35413
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:23.210037 13644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:23.211169 13644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:23.220439 13653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:23.220417 13650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:23.220551 13651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:23.220821 13644 server_base.cc:1034] running on GCE node
I20260811 11:49:23.221691 13644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:23.223014 13644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:23.224267 13644 hybrid_clock.cc:648] HybridClock initialized: now 1786448963224243 us; error 40 us; skew 500 ppm
Aug 11 11:49:23 dist-test-slave-vkjp krb5kdc[13627](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448963, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:23.227837 13644 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:49:23.228873 13644 webserver.cc:460] Webserver started at http://127.0.0.1:42257/ using document root <none> and password file <none>
I20260811 11:49:23.229482 13644 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:23.229581 13644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:23.229835 13644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:23.232105 13644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "6bff238e372d4e7db51a3877c107b49c"
format_stamp: "Formatted at 2026-08-11 11:49:23 on dist-test-slave-vkjp"
server_key: "a175189aa3a8a8d8958f1def53099538"
server_key_iv: "7f8560b7056898502dc70ed345aae9ea"
server_key_version: "encryptionkey@0"
I20260811 11:49:23.232733 13644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "6bff238e372d4e7db51a3877c107b49c"
format_stamp: "Formatted at 2026-08-11 11:49:23 on dist-test-slave-vkjp"
server_key: "a175189aa3a8a8d8958f1def53099538"
server_key_iv: "7f8560b7056898502dc70ed345aae9ea"
server_key_version: "encryptionkey@0"
I20260811 11:49:23.236869 13644 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260811 11:49:23.239773 13663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:23.241413 13644 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:49:23.241602 13644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "6bff238e372d4e7db51a3877c107b49c"
format_stamp: "Formatted at 2026-08-11 11:49:23 on dist-test-slave-vkjp"
server_key: "a175189aa3a8a8d8958f1def53099538"
server_key_iv: "7f8560b7056898502dc70ed345aae9ea"
server_key_version: "encryptionkey@0"
I20260811 11:49:23.241751 13644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:23.263288 13644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:23.266587 13644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:23.266822 13644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:23.274861 13644 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35413
I20260811 11:49:23.274876 13726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35413 every 8 connection(s)
I20260811 11:49:23.276000 13644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:23.278515 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 13644
I20260811 11:49:23.278666 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:23.279018 21457 external_mini_cluster.cc:1428] Setting key 8b5f32b0898282f2bfa537c57923bf12
I20260811 11:49:23.279186 13727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:23.286940 13727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c: Bootstrap starting.
I20260811 11:49:23.289934 13727 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:23.289935 13730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:23.280615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37825 (local address 127.0.0.1:35413)
0811 11:49:23.281096 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:23.281117 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:23.281163 (+ 46us) server_negotiation.cc:407] Connection header received
0811 11:49:23.282149 (+ 986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:23.282176 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:23.282637 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:23.283055 (+ 418us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:23.283536 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:23.285035 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:23.285947 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:23.286648 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:23.286813 (+ 165us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:23.287751 (+ 938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:23.287758 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:23.287774 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:23.288292 (+ 518us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:23.288369 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:23.288403 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:23.288558 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:23.288787 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 11:49:23.288935 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":131,"threads_started":1}
I20260811 11:49:23.290903 13727 log.cc:824] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:23.293287 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:49:23.293448 13727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c: No bootstrap required, opened a new log
I20260811 11:49:23.297994 13727 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bff238e372d4e7db51a3877c107b49c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35413 } }
I20260811 11:49:23.298295 13727 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:23.298400 13727 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bff238e372d4e7db51a3877c107b49c, State: Initialized, Role: FOLLOWER
I20260811 11:49:23.298882 13727 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bff238e372d4e7db51a3877c107b49c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35413 } }
I20260811 11:49:23.299045 13727 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:23.299162 13727 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:23.299299 13727 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:23.300278 13730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:23.295475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41787 (local address 127.0.0.1:35413)
0811 11:49:23.295625 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:23.295631 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:23.295866 (+ 235us) server_negotiation.cc:407] Connection header received
0811 11:49:23.295961 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:23.295965 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:23.296012 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:23.296098 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:23.296352 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:23.297160 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:23.298351 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:23.298709 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:23.298827 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:23.299805 (+ 978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:23.299809 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:23.299812 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:23.299826 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:23.299860 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:23.299872 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:23.299974 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:23.300101 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 11:49:23.300136 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 11:49:23.300411 13727 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bff238e372d4e7db51a3877c107b49c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35413 } }
I20260811 11:49:23.300804 13727 leader_election.cc:302] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6bff238e372d4e7db51a3877c107b49c; no voters:
I20260811 11:49:23.301157 13727 leader_election.cc:288] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:23.301275 13740 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:23.301599 13740 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c [term 1 LEADER]: Becoming Leader. State: Replica: 6bff238e372d4e7db51a3877c107b49c, State: Running, Role: LEADER
I20260811 11:49:23.301921 13740 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bff238e372d4e7db51a3877c107b49c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35413 } }
I20260811 11:49:23.302563 13727 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:23.303791 13742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6bff238e372d4e7db51a3877c107b49c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bff238e372d4e7db51a3877c107b49c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35413 } } }
I20260811 11:49:23.303939 13742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:23.305195 13743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6bff238e372d4e7db51a3877c107b49c. Latest consensus state: current_term: 1 leader_uuid: "6bff238e372d4e7db51a3877c107b49c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bff238e372d4e7db51a3877c107b49c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35413 } } }
I20260811 11:49:23.305321 13743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c [sys.catalog]: This master's current role is: LEADER
W20260811 11:49:23.307586 13756 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:49:23.307654 13756 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:49:23.307739 13750 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:23.308537 13750 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:23.314440 13750 catalog_manager.cc:1347] Generated new cluster ID: d823e72d952d4557829ae489d6f5ece5
I20260811 11:49:23.314535 13750 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:23.345338 13750 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:23.346640 13750 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:23.359051 13750 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6bff238e372d4e7db51a3877c107b49c: Generated new TSK 0
I20260811 11:49:23.359963 13750 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:49:23.375011 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 13644
W20260811 11:49:23.384433 13624 connection.cc:535] client connection to 127.0.0.1:35413 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35413): Connection reset by peer (error 104)
2026-08-11T11:49:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1611 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:23 dist-test-slave-vkjp krb5kdc[13762](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:23 dist-test-slave-vkjp krb5kdc[13762](info): set up 2 sockets
Aug 11 11:49:23 dist-test-slave-vkjp krb5kdc[13762](info): commencing operation
krb5kdc: starting...
W20260811 11:49:24.619992 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:24 dist-test-slave-vkjp krb5kdc[13762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448964, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:49:24.758628 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40763
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40763
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:24.876688 13776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:24.877048 13776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:24.877135 13776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:24.881505 13776 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:24.881623 13776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:24.881661 13776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:24.881696 13776 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:24.881728 13776 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:24.887579 13776 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40763
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40763
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13776
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:24.888789 13776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:24.889882 13776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:24.898983 13783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:24.899071 13784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:24.899138 13776 server_base.cc:1034] running on GCE node
W20260811 11:49:24.899374 13786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:24.899995 13776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:24.901152 13776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:24.902324 13776 hybrid_clock.cc:648] HybridClock initialized: now 1786448964902297 us; error 37 us; skew 500 ppm
Aug 11 11:49:24 dist-test-slave-vkjp krb5kdc[13762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448964, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:24.905373 13776 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:49:24.906499 13776 webserver.cc:460] Webserver started at http://127.0.0.1:36527/ using document root <none> and password file <none>
I20260811 11:49:24.907194 13776 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:24.907303 13776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:24.907553 13776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:24.909806 13776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "6dd7deeabb6f4dd8a3f33aaeb61bb342"
format_stamp: "Formatted at 2026-08-11 11:49:24 on dist-test-slave-vkjp"
server_key: "71af51dfdda22301396afd74249a9242"
server_key_iv: "54595c9e8cf77d6448fc039af9d53421"
server_key_version: "encryptionkey@0"
I20260811 11:49:24.910432 13776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "6dd7deeabb6f4dd8a3f33aaeb61bb342"
format_stamp: "Formatted at 2026-08-11 11:49:24 on dist-test-slave-vkjp"
server_key: "71af51dfdda22301396afd74249a9242"
server_key_iv: "54595c9e8cf77d6448fc039af9d53421"
server_key_version: "encryptionkey@0"
I20260811 11:49:24.914702 13776 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260811 11:49:24.917477 13794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:24.918874 13776 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 11:49:24.919070 13776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "6dd7deeabb6f4dd8a3f33aaeb61bb342"
format_stamp: "Formatted at 2026-08-11 11:49:24 on dist-test-slave-vkjp"
server_key: "71af51dfdda22301396afd74249a9242"
server_key_iv: "54595c9e8cf77d6448fc039af9d53421"
server_key_version: "encryptionkey@0"
I20260811 11:49:24.919260 13776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:24.924192 13776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:24.927392 13776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:24.927601 13776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:24.935266 13776 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40763
I20260811 11:49:24.935294 13856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40763 every 8 connection(s)
I20260811 11:49:24.936368 13776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:24.939276 13858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:24.945200 13858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342: Bootstrap starting.
I20260811 11:49:24.946297 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 13776
I20260811 11:49:24.946424 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:24.946805 21457 external_mini_cluster.cc:1428] Setting key 5b857bf5f788092b1340d75e0eb0b868
I20260811 11:49:24.948240 13858 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:24.949056 13858 log.cc:824] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:24.951418 13858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342: No bootstrap required, opened a new log
I20260811 11:49:24.952407 13861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:24.948092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40701 (local address 127.0.0.1:40763)
0811 11:49:24.948611 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:24.948627 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:24.948665 (+ 38us) server_negotiation.cc:407] Connection header received
0811 11:49:24.949467 (+ 802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:24.949495 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:24.949866 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:24.950264 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:24.951145 (+ 881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:24.951151 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:24.951167 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:24.951184 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:24.951241 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:24.951261 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:24.951390 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:24.951495 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 11:49:24.951672 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":132,"threads_started":1}
I20260811 11:49:24.955541 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:49:24.955883 13858 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dd7deeabb6f4dd8a3f33aaeb61bb342" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40763 } }
I20260811 11:49:24.956161 13858 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:24.956252 13858 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dd7deeabb6f4dd8a3f33aaeb61bb342, State: Initialized, Role: FOLLOWER
I20260811 11:49:24.956704 13858 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dd7deeabb6f4dd8a3f33aaeb61bb342" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40763 } }
I20260811 11:49:24.956863 13858 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:24.956969 13858 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:24.957103 13858 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:24.958263 13858 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dd7deeabb6f4dd8a3f33aaeb61bb342" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40763 } }
I20260811 11:49:24.958680 13858 leader_election.cc:302] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6dd7deeabb6f4dd8a3f33aaeb61bb342; no voters:
I20260811 11:49:24.959138 13858 leader_election.cc:288] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:24.959255 13868 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:24.959497 13868 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342 [term 1 LEADER]: Becoming Leader. State: Replica: 6dd7deeabb6f4dd8a3f33aaeb61bb342, State: Running, Role: LEADER
I20260811 11:49:24.960053 13861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:24.957953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48273 (local address 127.0.0.1:40763)
0811 11:49:24.958103 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:24.958110 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:24.958346 (+ 236us) server_negotiation.cc:407] Connection header received
0811 11:49:24.958516 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:24.958519 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:24.958563 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:24.958653 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:24.959562 (+ 909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:24.959568 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:24.959570 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:24.959585 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:24.959620 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:24.959632 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:24.959697 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:24.959886 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 11:49:24.959932 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 11:49:24.960071 13868 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dd7deeabb6f4dd8a3f33aaeb61bb342" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40763 } }
I20260811 11:49:24.960665 13858 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:24.962024 13869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6dd7deeabb6f4dd8a3f33aaeb61bb342" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dd7deeabb6f4dd8a3f33aaeb61bb342" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40763 } } }
I20260811 11:49:24.962167 13869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:24.962628 13878 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:24.962628 13870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6dd7deeabb6f4dd8a3f33aaeb61bb342. Latest consensus state: current_term: 1 leader_uuid: "6dd7deeabb6f4dd8a3f33aaeb61bb342" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dd7deeabb6f4dd8a3f33aaeb61bb342" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40763 } } }
I20260811 11:49:24.962818 13870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:24.965775 13878 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:24.972026 13878 catalog_manager.cc:1347] Generated new cluster ID: ea9a09962bb84ab39faf09acbcb8a086
I20260811 11:49:24.972157 13878 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:25.008069 13878 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:25.008528 13878 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:25.020427 13878 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6dd7deeabb6f4dd8a3f33aaeb61bb342: Generated new TSK 0
I20260811 11:49:25.021426 13878 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:49:25.038465 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 13776
2026-08-11T11:49:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1664 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:25 dist-test-slave-vkjp krb5kdc[13892](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:25 dist-test-slave-vkjp krb5kdc[13892](info): set up 2 sockets
Aug 11 11:49:25 dist-test-slave-vkjp krb5kdc[13892](info): commencing operation
krb5kdc: starting...
W20260811 11:49:26.228735 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:26 dist-test-slave-vkjp krb5kdc[13892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448966, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:49:26.366864 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46739
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46739
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:26.490152 13906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:26.490513 13906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:26.490598 13906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:26.494711 13906 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:26.494817 13906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:26.494858 13906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:26.494910 13906 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:26.494948 13906 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:26.500360 13906 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46739
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:26.501587 13906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:26.502712 13906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:26.511641 13912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:26.511660 13914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:26.511727 13906 server_base.cc:1034] running on GCE node
W20260811 11:49:26.511656 13911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:26.512526 13906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:26.513731 13906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:26.514937 13906 hybrid_clock.cc:648] HybridClock initialized: now 1786448966514907 us; error 44 us; skew 500 ppm
Aug 11 11:49:26 dist-test-slave-vkjp krb5kdc[13892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448966, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:26.517951 13906 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:49:26.518867 13906 webserver.cc:460] Webserver started at http://127.0.0.1:36247/ using document root <none> and password file <none>
I20260811 11:49:26.519498 13906 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:26.519567 13906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:26.519758 13906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:26.521876 13906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "e22dba8546d24a9c90eaa358775c0169"
format_stamp: "Formatted at 2026-08-11 11:49:26 on dist-test-slave-vkjp"
server_key: "23f619b61e02760ce8469532f551ee07"
server_key_iv: "870f0c0dc2775cbef5cf4be4ea369c82"
server_key_version: "encryptionkey@0"
I20260811 11:49:26.522431 13906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "e22dba8546d24a9c90eaa358775c0169"
format_stamp: "Formatted at 2026-08-11 11:49:26 on dist-test-slave-vkjp"
server_key: "23f619b61e02760ce8469532f551ee07"
server_key_iv: "870f0c0dc2775cbef5cf4be4ea369c82"
server_key_version: "encryptionkey@0"
I20260811 11:49:26.526353 13906 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 11:49:26.528900 13922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:26.530340 13906 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 11:49:26.530525 13906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "e22dba8546d24a9c90eaa358775c0169"
format_stamp: "Formatted at 2026-08-11 11:49:26 on dist-test-slave-vkjp"
server_key: "23f619b61e02760ce8469532f551ee07"
server_key_iv: "870f0c0dc2775cbef5cf4be4ea369c82"
server_key_version: "encryptionkey@0"
I20260811 11:49:26.530661 13906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:26.543036 13906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:26.546603 13906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:26.546837 13906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:26.554730 13906 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46739
I20260811 11:49:26.554781 13985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46739 every 8 connection(s)
I20260811 11:49:26.555797 13906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:26.558725 13986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:26.564599 13986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169: Bootstrap starting.
I20260811 11:49:26.565104 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 13906
I20260811 11:49:26.565292 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:26.565634 21457 external_mini_cluster.cc:1428] Setting key 09dc339c34285c26c26cbf18df7bc42d
I20260811 11:49:26.567576 13986 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:26.568492 13986 log.cc:824] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:26.570833 13986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169: No bootstrap required, opened a new log
I20260811 11:49:26.574930 13986 raft_consensus.cc:348] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e22dba8546d24a9c90eaa358775c0169" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46739 } }
I20260811 11:49:26.575244 13986 raft_consensus.cc:374] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:26.575320 13986 raft_consensus.cc:729] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e22dba8546d24a9c90eaa358775c0169, State: Initialized, Role: FOLLOWER
Aug 11 11:49:26 dist-test-slave-vkjp krb5kdc[13892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448966, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 11:49:26.575850 13986 consensus_queue.cc:260] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e22dba8546d24a9c90eaa358775c0169" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46739 } }
I20260811 11:49:26.576031 13986 raft_consensus.cc:388] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:26.576104 13986 raft_consensus.cc:482] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:26.576210 13986 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:26.577217 13986 raft_consensus.cc:504] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e22dba8546d24a9c90eaa358775c0169" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46739 } }
I20260811 11:49:26.577629 13986 leader_election.cc:302] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e22dba8546d24a9c90eaa358775c0169; no voters:
I20260811 11:49:26.578035 13986 leader_election.cc:288] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:26.578169 13991 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:26.578437 13991 raft_consensus.cc:686] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169 [term 1 LEADER]: Becoming Leader. State: Replica: e22dba8546d24a9c90eaa358775c0169, State: Running, Role: LEADER
I20260811 11:49:26.578815 13991 consensus_queue.cc:237] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e22dba8546d24a9c90eaa358775c0169" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46739 } }
I20260811 11:49:26.579461 13986 sys_catalog.cc:564] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:26.580714 13992 sys_catalog.cc:455] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e22dba8546d24a9c90eaa358775c0169" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e22dba8546d24a9c90eaa358775c0169" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46739 } } }
I20260811 11:49:26.580881 13992 sys_catalog.cc:458] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:26.581408 13993 sys_catalog.cc:455] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e22dba8546d24a9c90eaa358775c0169. Latest consensus state: current_term: 1 leader_uuid: "e22dba8546d24a9c90eaa358775c0169" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e22dba8546d24a9c90eaa358775c0169" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46739 } } }
I20260811 11:49:26.581596 13993 sys_catalog.cc:458] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:26.583424 13989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:26.567028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49721 (local address 127.0.0.1:46739)
0811 11:49:26.567546 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:26.567567 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:26.567614 (+ 47us) server_negotiation.cc:407] Connection header received
0811 11:49:26.568538 (+ 924us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:26.568564 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:26.569003 (+ 439us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:26.569323 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:26.570073 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:26.571538 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:26.572446 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:26.573192 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:26.573357 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:26.576333 (+ 2976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:26.576339 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:26.576358 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:26.576397 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:26.578560 (+ 2163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:26.579163 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:26.579178 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:26.579184 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:26.579414 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:26.579780 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:26.579784 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:26.579786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:26.580404 (+ 618us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:26.581448 (+ 1044us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:26.581676 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 11:49:26.582344 (+ 668us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":120,"threads_started":1}
W20260811 11:49:26.585237 14008 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:49:26.585333 14008 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:49:26.585430 14003 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:26.586333 14003 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:26.586465 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:49:26.592839 14003 catalog_manager.cc:1347] Generated new cluster ID: 16705407c90e4ac2a8d464b317626325
I20260811 11:49:26.592955 14003 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:26.598371 13989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:26.590071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51299 (local address 127.0.0.1:46739)
0811 11:49:26.590197 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:26.590200 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:26.590212 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:49:26.590244 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:26.590246 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:26.590281 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:26.590379 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:26.591293 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:26.592102 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:26.593253 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:26.593520 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:26.593645 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:26.595049 (+ 1404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:26.595053 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:26.595056 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:26.595107 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:26.596633 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:26.597083 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:26.597087 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:26.597089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:26.597170 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:26.597460 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:26.597464 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:26.597466 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:26.597655 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:26.597798 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:26.598060 (+ 262us) server_negotiation.cc:299] Negotiation successful
0811 11:49:26.598179 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 11:49:26.630937 14003 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:26.632001 14003 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:26.640316 14003 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e22dba8546d24a9c90eaa358775c0169: Generated new TSK 0
I20260811 11:49:26.641161 14003 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:49:26.645285 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 13906
2026-08-11T11:49:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1607 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:26 dist-test-slave-vkjp krb5kdc[14021](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:26 dist-test-slave-vkjp krb5kdc[14021](info): set up 2 sockets
Aug 11 11:49:26 dist-test-slave-vkjp krb5kdc[14021](info): commencing operation
krb5kdc: starting...
W20260811 11:49:27.791265 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:27 dist-test-slave-vkjp krb5kdc[14021](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448967, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:49:27.931568 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43835
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43835
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:28.049902 14036 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:28.050205 14036 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:28.050249 14036 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:28.054483 14036 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:28.054575 14036 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:28.054596 14036 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:28.054613 14036 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:28.054629 14036 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:28.060320 14036 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43835
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14036
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:28.061548 14036 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:28.062646 14036 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:28.071718 14041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:28.071734 14042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:28.071719 14046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:28.072196 14036 server_base.cc:1034] running on GCE node
I20260811 11:49:28.072901 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:28.074244 14036 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:28.075457 14036 hybrid_clock.cc:648] HybridClock initialized: now 1786448968075442 us; error 37 us; skew 500 ppm
Aug 11 11:49:28 dist-test-slave-vkjp krb5kdc[14021](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448968, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:28.078274 14036 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:49:28.079260 14036 webserver.cc:460] Webserver started at http://127.0.0.1:42985/ using document root <none> and password file <none>
I20260811 11:49:28.079816 14036 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:28.079876 14036 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:28.080062 14036 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:28.082190 14036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "2703a16f3e25419fb11a6b0798a83ad6"
format_stamp: "Formatted at 2026-08-11 11:49:28 on dist-test-slave-vkjp"
server_key: "d6f2e6ba8c2fa3c941c834bc5b784626"
server_key_iv: "da475bc8c8303df5fad568a68b8aa200"
server_key_version: "encryptionkey@0"
I20260811 11:49:28.082726 14036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "2703a16f3e25419fb11a6b0798a83ad6"
format_stamp: "Formatted at 2026-08-11 11:49:28 on dist-test-slave-vkjp"
server_key: "d6f2e6ba8c2fa3c941c834bc5b784626"
server_key_iv: "da475bc8c8303df5fad568a68b8aa200"
server_key_version: "encryptionkey@0"
I20260811 11:49:28.086728 14036 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260811 11:49:28.089349 14054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:28.090781 14036 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 11:49:28.090888 14036 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "2703a16f3e25419fb11a6b0798a83ad6"
format_stamp: "Formatted at 2026-08-11 11:49:28 on dist-test-slave-vkjp"
server_key: "d6f2e6ba8c2fa3c941c834bc5b784626"
server_key_iv: "da475bc8c8303df5fad568a68b8aa200"
server_key_version: "encryptionkey@0"
I20260811 11:49:28.090986 14036 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:28.104580 14036 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:28.107959 14036 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:28.108125 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:28.116251 14036 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43835
I20260811 11:49:28.116338 14112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43835 every 8 connection(s)
I20260811 11:49:28.117343 14036 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:28.119400 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 14036
I20260811 11:49:28.119591 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:28.119895 21457 external_mini_cluster.cc:1428] Setting key fcd8cc90a60589e36be21e9671526c0c
I20260811 11:49:28.120497 14113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:28.127851 14113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6: Bootstrap starting.
I20260811 11:49:28.130254 14118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:28.121308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59513 (local address 127.0.0.1:43835)
0811 11:49:28.121734 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:28.121754 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:28.121798 (+ 44us) server_negotiation.cc:407] Connection header received
0811 11:49:28.122710 (+ 912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:28.122733 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:28.123198 (+ 465us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:28.123586 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:28.124024 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:28.125556 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:28.126443 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:28.127200 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:28.127358 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:28.128216 (+ 858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:28.128223 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:28.128237 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:28.128733 (+ 496us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:28.128803 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:28.128835 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:28.128936 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:28.129099 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 11:49:28.129326 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":112,"threads_started":1}
I20260811 11:49:28.130632 14113 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:28.131557 14113 log.cc:824] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:28.133404 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:49:28.133926 14113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6: No bootstrap required, opened a new log
I20260811 11:49:28.137916 14113 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2703a16f3e25419fb11a6b0798a83ad6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43835 } }
I20260811 11:49:28.138247 14113 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:28.138309 14113 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2703a16f3e25419fb11a6b0798a83ad6, State: Initialized, Role: FOLLOWER
I20260811 11:49:28.138813 14113 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2703a16f3e25419fb11a6b0798a83ad6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43835 } }
I20260811 11:49:28.139032 14113 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:28.139135 14113 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:28.139262 14113 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:28.140683 14113 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2703a16f3e25419fb11a6b0798a83ad6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43835 } }
I20260811 11:49:28.140858 14118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:28.135780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38891 (local address 127.0.0.1:43835)
0811 11:49:28.135930 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:28.135935 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:28.136159 (+ 224us) server_negotiation.cc:407] Connection header received
0811 11:49:28.136286 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:28.136288 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:28.136330 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:28.136397 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:28.136763 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:28.137809 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:28.138930 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:28.139352 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:28.139453 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:28.140349 (+ 896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:28.140352 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:28.140354 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:28.140366 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:28.140391 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:28.140401 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:28.140457 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:28.140610 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 11:49:28.140660 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 11:49:28.141196 14113 leader_election.cc:302] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2703a16f3e25419fb11a6b0798a83ad6; no voters:
I20260811 11:49:28.141640 14113 leader_election.cc:288] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:28.141752 14126 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:28.141993 14126 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6 [term 1 LEADER]: Becoming Leader. State: Replica: 2703a16f3e25419fb11a6b0798a83ad6, State: Running, Role: LEADER
I20260811 11:49:28.142349 14126 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2703a16f3e25419fb11a6b0798a83ad6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43835 } }
I20260811 11:49:28.142990 14113 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:28.143657 14126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2703a16f3e25419fb11a6b0798a83ad6. Latest consensus state: current_term: 1 leader_uuid: "2703a16f3e25419fb11a6b0798a83ad6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2703a16f3e25419fb11a6b0798a83ad6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43835 } } }
I20260811 11:49:28.143877 14126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:28.144167 14127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2703a16f3e25419fb11a6b0798a83ad6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2703a16f3e25419fb11a6b0798a83ad6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43835 } } }
I20260811 11:49:28.144321 14135 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:28.147125 14127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:28.148170 14135 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:28.154302 14135 catalog_manager.cc:1347] Generated new cluster ID: 9be3abce421d411585b6e88a5956fc87
I20260811 11:49:28.154395 14135 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:28.164315 14135 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:28.165321 14135 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:28.170343 14135 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2703a16f3e25419fb11a6b0798a83ad6: Generated new TSK 0
I20260811 11:49:28.171321 14135 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:49:28.183009 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 14036
2026-08-11T11:49:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1535 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:28 dist-test-slave-vkjp krb5kdc[14152](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:28 dist-test-slave-vkjp krb5kdc[14152](info): set up 2 sockets
Aug 11 11:49:28 dist-test-slave-vkjp krb5kdc[14152](info): commencing operation
krb5kdc: starting...
W20260811 11:49:29.339044 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:29 dist-test-slave-vkjp krb5kdc[14152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448969, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:49:29.476572 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40699
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40699
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:29.595520 14166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:29.595893 14166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:29.596028 14166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:29.600600 14166 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:29.600673 14166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:29.600693 14166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:29.600739 14166 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:29.600768 14166 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:29.606422 14166 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40699
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:29.607730 14166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:29.608799 14166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:29.617807 14174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:29.617918 14172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:29.617862 14166 server_base.cc:1034] running on GCE node
W20260811 11:49:29.617873 14171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:29.618695 14166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:29.619902 14166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:29.621096 14166 hybrid_clock.cc:648] HybridClock initialized: now 1786448969621066 us; error 40 us; skew 500 ppm
Aug 11 11:49:29 dist-test-slave-vkjp krb5kdc[14152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448969, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:29.623922 14166 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:49:29.624881 14166 webserver.cc:460] Webserver started at http://127.0.0.1:36493/ using document root <none> and password file <none>
I20260811 11:49:29.625456 14166 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:29.625550 14166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:29.625789 14166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:29.627941 14166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "65b32e8052bd4693a3dfb131122aa47c"
format_stamp: "Formatted at 2026-08-11 11:49:29 on dist-test-slave-vkjp"
server_key: "bbdfc89839df623410a6d28966af382e"
server_key_iv: "534aa466e1f229c4a242e9a653c8a797"
server_key_version: "encryptionkey@0"
I20260811 11:49:29.628531 14166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "65b32e8052bd4693a3dfb131122aa47c"
format_stamp: "Formatted at 2026-08-11 11:49:29 on dist-test-slave-vkjp"
server_key: "bbdfc89839df623410a6d28966af382e"
server_key_iv: "534aa466e1f229c4a242e9a653c8a797"
server_key_version: "encryptionkey@0"
I20260811 11:49:29.632247 14166 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260811 11:49:29.634697 14182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:29.635964 14166 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:49:29.636113 14166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "65b32e8052bd4693a3dfb131122aa47c"
format_stamp: "Formatted at 2026-08-11 11:49:29 on dist-test-slave-vkjp"
server_key: "bbdfc89839df623410a6d28966af382e"
server_key_iv: "534aa466e1f229c4a242e9a653c8a797"
server_key_version: "encryptionkey@0"
I20260811 11:49:29.636232 14166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:29.641072 14166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:29.644723 14166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:29.644989 14166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:29.653429 14166 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40699
I20260811 11:49:29.653458 14242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40699 every 8 connection(s)
I20260811 11:49:29.654574 14166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:29.657527 14243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:29.663410 14243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c: Bootstrap starting.
I20260811 11:49:29.663846 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 14166
I20260811 11:49:29.663998 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:29.664284 21457 external_mini_cluster.cc:1428] Setting key 91f5e2b213f5481e3a8cf8a34c851204
I20260811 11:49:29.666356 14243 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:29.667192 14243 log.cc:824] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:29.669636 14243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c: No bootstrap required, opened a new log
I20260811 11:49:29.670243 14246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:29.665772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46599 (local address 127.0.0.1:40699)
0811 11:49:29.666280 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:29.666295 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:29.666383 (+ 88us) server_negotiation.cc:407] Connection header received
0811 11:49:29.667202 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:29.667222 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:29.667625 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:29.668025 (+ 400us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:29.668902 (+ 877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:29.668906 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:29.668916 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:29.668926 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:29.668979 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:29.668997 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:29.669087 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:29.669232 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 11:49:29.669468 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":144,"threads_started":1}
I20260811 11:49:29.673226 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:49:29.673642 14243 raft_consensus.cc:348] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65b32e8052bd4693a3dfb131122aa47c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40699 } }
I20260811 11:49:29.673969 14243 raft_consensus.cc:374] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:29.674033 14243 raft_consensus.cc:729] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65b32e8052bd4693a3dfb131122aa47c, State: Initialized, Role: FOLLOWER
I20260811 11:49:29.674547 14243 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65b32e8052bd4693a3dfb131122aa47c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40699 } }
I20260811 11:49:29.674784 14243 raft_consensus.cc:388] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:29.674880 14243 raft_consensus.cc:482] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:29.675036 14243 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:29.676429 14243 raft_consensus.cc:504] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65b32e8052bd4693a3dfb131122aa47c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40699 } }
I20260811 11:49:29.676890 14243 leader_election.cc:302] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 65b32e8052bd4693a3dfb131122aa47c; no voters:
I20260811 11:49:29.677277 14243 leader_election.cc:288] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:29.677397 14255 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:29.677696 14255 raft_consensus.cc:686] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c [term 1 LEADER]: Becoming Leader. State: Replica: 65b32e8052bd4693a3dfb131122aa47c, State: Running, Role: LEADER
I20260811 11:49:29.678023 14246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:29.675876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47615 (local address 127.0.0.1:40699)
0811 11:49:29.676046 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:29.676051 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:29.676268 (+ 217us) server_negotiation.cc:407] Connection header received
0811 11:49:29.676421 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:29.676423 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:29.676460 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:29.676535 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:29.677496 (+ 961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:29.677503 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:29.677507 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:29.677524 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:29.677562 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:29.677578 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:29.677687 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:29.677858 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 11:49:29.677901 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 11:49:29.678301 14255 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65b32e8052bd4693a3dfb131122aa47c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40699 } }
I20260811 11:49:29.678791 14243 sys_catalog.cc:564] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:29.680387 14257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65b32e8052bd4693a3dfb131122aa47c. Latest consensus state: current_term: 1 leader_uuid: "65b32e8052bd4693a3dfb131122aa47c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65b32e8052bd4693a3dfb131122aa47c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40699 } } }
I20260811 11:49:29.680429 14256 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "65b32e8052bd4693a3dfb131122aa47c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65b32e8052bd4693a3dfb131122aa47c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40699 } } }
I20260811 11:49:29.680539 14257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:29.680550 14256 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:29.680949 14267 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:29.684202 14267 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:29.689392 14267 catalog_manager.cc:1347] Generated new cluster ID: a934caff229f4aec8b065e2e72d2b01a
I20260811 11:49:29.689494 14267 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:29.706775 14267 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:29.707186 14267 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:29.716650 14267 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 65b32e8052bd4693a3dfb131122aa47c: Generated new TSK 0
I20260811 11:49:29.717573 14267 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:49:29.726624 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 14166
2026-08-11T11:49:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1543 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:29 dist-test-slave-vkjp krb5kdc[14277](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:29 dist-test-slave-vkjp krb5kdc[14277](info): set up 2 sockets
Aug 11 11:49:29 dist-test-slave-vkjp krb5kdc[14277](info): commencing operation
krb5kdc: starting...
W20260811 11:49:30.881181 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.007s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:30 dist-test-slave-vkjp krb5kdc[14277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448970, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:49:31.027138 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34047
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34047
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:31.146237 14293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:31.146548 14293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:31.146593 14293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:31.151055 14293 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:31.151165 14293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:31.151186 14293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:31.151204 14293 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:31.151249 14293 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:31.157006 14293 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34047
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34047
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14293
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:31.158185 14293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:31.159281 14293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:31.168251 14300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:31.168290 14303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:31.168313 14293 server_base.cc:1034] running on GCE node
W20260811 11:49:31.168475 14299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:31.169121 14293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:31.170281 14293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:31.171478 14293 hybrid_clock.cc:648] HybridClock initialized: now 1786448971171463 us; error 26 us; skew 500 ppm
Aug 11 11:49:31 dist-test-slave-vkjp krb5kdc[14277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448971, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:31.178429 14293 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:49:31.179554 14293 webserver.cc:460] Webserver started at http://127.0.0.1:40341/ using document root <none> and password file <none>
I20260811 11:49:31.180204 14293 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:31.180306 14293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:31.180557 14293 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:31.182835 14293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "5865fbb8be104b90be71c1cc27b509a7"
format_stamp: "Formatted at 2026-08-11 11:49:31 on dist-test-slave-vkjp"
server_key: "bd0cee7fec6808ed895aaee6e823a0de"
server_key_iv: "fcf98f15083b6de35e25ee7a77bcb50f"
server_key_version: "encryptionkey@0"
I20260811 11:49:31.183476 14293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "5865fbb8be104b90be71c1cc27b509a7"
format_stamp: "Formatted at 2026-08-11 11:49:31 on dist-test-slave-vkjp"
server_key: "bd0cee7fec6808ed895aaee6e823a0de"
server_key_iv: "fcf98f15083b6de35e25ee7a77bcb50f"
server_key_version: "encryptionkey@0"
I20260811 11:49:31.187575 14293 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 11:49:31.190228 14313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:31.191779 14293 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:49:31.191949 14293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "5865fbb8be104b90be71c1cc27b509a7"
format_stamp: "Formatted at 2026-08-11 11:49:31 on dist-test-slave-vkjp"
server_key: "bd0cee7fec6808ed895aaee6e823a0de"
server_key_iv: "fcf98f15083b6de35e25ee7a77bcb50f"
server_key_version: "encryptionkey@0"
I20260811 11:49:31.192114 14293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:31.207224 14293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:31.210762 14293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:31.211014 14293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:31.218849 14293 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34047
I20260811 11:49:31.218881 14368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34047 every 8 connection(s)
I20260811 11:49:31.219887 14293 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:31.222824 14369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:31.225546 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 14293
I20260811 11:49:31.225728 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:31.226015 21457 external_mini_cluster.cc:1428] Setting key 9726c455c64222c7a37084ccc2098af4
I20260811 11:49:31.229292 14369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7: Bootstrap starting.
I20260811 11:49:31.231757 14369 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:31.232595 14369 log.cc:824] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:31.234929 14369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7: No bootstrap required, opened a new log
Aug 11 11:49:31 dist-test-slave-vkjp krb5kdc[14277](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448970, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 11:49:31.238806 14369 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5865fbb8be104b90be71c1cc27b509a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34047 } }
I20260811 11:49:31.239166 14369 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:31.239272 14369 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5865fbb8be104b90be71c1cc27b509a7, State: Initialized, Role: FOLLOWER
I20260811 11:49:31.239826 14369 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5865fbb8be104b90be71c1cc27b509a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34047 } }
I20260811 11:49:31.240007 14369 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:31.240105 14369 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:31.240221 14369 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:31.241297 14369 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5865fbb8be104b90be71c1cc27b509a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34047 } }
I20260811 11:49:31.241771 14369 leader_election.cc:302] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5865fbb8be104b90be71c1cc27b509a7; no voters:
I20260811 11:49:31.242134 14369 leader_election.cc:288] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:31.242276 14375 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:31.242515 14375 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7 [term 1 LEADER]: Becoming Leader. State: Replica: 5865fbb8be104b90be71c1cc27b509a7, State: Running, Role: LEADER
I20260811 11:49:31.242731 14373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:31.227637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.30:44279 (local address 127.0.0.1:34047)
0811 11:49:31.228112 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:31.228129 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:31.228166 (+ 37us) server_negotiation.cc:407] Connection header received
0811 11:49:31.228820 (+ 654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:31.228838 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:31.229200 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:31.229563 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:31.230449 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:31.231563 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:31.232543 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:31.233112 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:31.233301 (+ 189us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:31.236148 (+ 2847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:31.236154 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:31.236170 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:31.236206 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:31.238767 (+ 2561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:31.239603 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:31.239609 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:31.239615 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:31.239751 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:31.240211 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:31.240215 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:31.240217 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:31.240720 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:31.241008 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:31.241354 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 11:49:31.241623 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":156,"threads_started":1}
I20260811 11:49:31.242916 14375 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5865fbb8be104b90be71c1cc27b509a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34047 } }
I20260811 11:49:31.243603 14369 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:31.244359 14377 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5865fbb8be104b90be71c1cc27b509a7. Latest consensus state: current_term: 1 leader_uuid: "5865fbb8be104b90be71c1cc27b509a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5865fbb8be104b90be71c1cc27b509a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34047 } } }
I20260811 11:49:31.244582 14377 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:31.244807 14376 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5865fbb8be104b90be71c1cc27b509a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5865fbb8be104b90be71c1cc27b509a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34047 } } }
I20260811 11:49:31.244903 14376 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:31.246388 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 11:49:31.249866 14390 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:49:31.249987 14390 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:49:31.250051 14384 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:31.251008 14384 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:31.257804 14384 catalog_manager.cc:1347] Generated new cluster ID: 933741b4544c494690d812b011985f3f
I20260811 11:49:31.257985 14384 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:31.258008 14373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:31.248571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.30:40571 (local address 127.0.0.1:34047)
0811 11:49:31.248690 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:31.248694 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:31.249003 (+ 309us) server_negotiation.cc:407] Connection header received
0811 11:49:31.249168 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:31.249171 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:31.249215 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:31.249308 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:31.250091 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:31.250720 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:31.251771 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:31.252018 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:31.252131 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:31.253624 (+ 1493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:31.253628 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:31.253630 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:31.253661 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:31.255229 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:31.256200 (+ 971us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:31.256203 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:31.256205 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:31.256298 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:31.256735 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:31.256738 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:31.256739 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:31.256963 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:31.257085 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:31.257737 (+ 652us) server_negotiation.cc:299] Negotiation successful
0811 11:49:31.257845 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 11:49:31.271657 14384 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:31.272658 14384 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:31.281466 14384 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5865fbb8be104b90be71c1cc27b509a7: Generated new TSK 0
I20260811 11:49:31.282238 14384 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:49:31.290130 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 14293
W20260811 11:49:31.301411 14274 connection.cc:535] client connection to 127.0.0.1:34047 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34047): Connection reset by peer (error 104)
2026-08-11T11:49:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1565 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:31 dist-test-slave-vkjp krb5kdc[14404](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:31 dist-test-slave-vkjp krb5kdc[14404](info): set up 2 sockets
Aug 11 11:49:31 dist-test-slave-vkjp krb5kdc[14404](info): commencing operation
krb5kdc: starting...
W20260811 11:49:32.475605 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:32 dist-test-slave-vkjp krb5kdc[14404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448972, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:49:32.607811 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34065
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34065
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:32.731853 14420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:32.732184 14420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:32.732259 14420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:32.736393 14420 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:32.736498 14420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:32.736537 14420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:32.736591 14420 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:32.736631 14420 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:32.742188 14420 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34065
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34065
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14420
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:32.743523 14420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:32.744640 14420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:32.753304 14429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:32.753356 14426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:32.753523 14420 server_base.cc:1034] running on GCE node
W20260811 11:49:32.753360 14427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:32.754199 14420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:32.755409 14420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:32.756618 14420 hybrid_clock.cc:648] HybridClock initialized: now 1786448972756583 us; error 47 us; skew 500 ppm
Aug 11 11:49:32 dist-test-slave-vkjp krb5kdc[14404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448972, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:32.759498 14420 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:49:32.760437 14420 webserver.cc:460] Webserver started at http://127.0.0.1:43479/ using document root <none> and password file <none>
I20260811 11:49:32.761050 14420 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:32.761147 14420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:32.761389 14420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:32.763768 14420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "ee5b64b894d644a69716f3c25c7f2375"
format_stamp: "Formatted at 2026-08-11 11:49:32 on dist-test-slave-vkjp"
server_key: "3b0e14f7052b7b9371e9539e267c9f3f"
server_key_iv: "e4179222a077fa054b4a7acfc068f6d7"
server_key_version: "encryptionkey@0"
I20260811 11:49:32.764571 14420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "ee5b64b894d644a69716f3c25c7f2375"
format_stamp: "Formatted at 2026-08-11 11:49:32 on dist-test-slave-vkjp"
server_key: "3b0e14f7052b7b9371e9539e267c9f3f"
server_key_iv: "e4179222a077fa054b4a7acfc068f6d7"
server_key_version: "encryptionkey@0"
I20260811 11:49:32.768638 14420 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 11:49:32.771044 14436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:32.772353 14420 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 11:49:32.772518 14420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "ee5b64b894d644a69716f3c25c7f2375"
format_stamp: "Formatted at 2026-08-11 11:49:32 on dist-test-slave-vkjp"
server_key: "3b0e14f7052b7b9371e9539e267c9f3f"
server_key_iv: "e4179222a077fa054b4a7acfc068f6d7"
server_key_version: "encryptionkey@0"
I20260811 11:49:32.772639 14420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:32.795430 14420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:32.798794 14420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:32.799021 14420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:32.807296 14420 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34065
I20260811 11:49:32.807328 14497 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34065 every 8 connection(s)
I20260811 11:49:32.808382 14420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:32.811352 14498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:32.815547 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 14420
I20260811 11:49:32.815701 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:32.815996 21457 external_mini_cluster.cc:1428] Setting key 11243edd2f0151b95bc379b40c56b515
I20260811 11:49:32.817670 14498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375: Bootstrap starting.
I20260811 11:49:32.820534 14498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:32.821484 14498 log.cc:824] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:32.823799 14498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375: No bootstrap required, opened a new log
I20260811 11:49:32.826665 14502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:32.817506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.30:50873 (local address 127.0.0.1:34065)
0811 11:49:32.817956 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:32.817977 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:32.818021 (+ 44us) server_negotiation.cc:407] Connection header received
0811 11:49:32.818870 (+ 849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:32.818899 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:32.819391 (+ 492us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:32.819760 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:32.820191 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:32.821758 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:32.822836 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:32.823558 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:32.823729 (+ 171us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:32.824653 (+ 924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:32.824660 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:32.824675 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:32.825179 (+ 504us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:32.825247 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:32.825279 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:32.825420 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:32.825550 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 11:49:32.825689 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":118,"threads_started":1}
I20260811 11:49:32.828538 14498 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee5b64b894d644a69716f3c25c7f2375" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34065 } }
I20260811 11:49:32.828853 14498 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:32.828918 14498 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee5b64b894d644a69716f3c25c7f2375, State: Initialized, Role: FOLLOWER
I20260811 11:49:32.829453 14498 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee5b64b894d644a69716f3c25c7f2375" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34065 } }
I20260811 11:49:32.829619 14498 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:32.829696 14498 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:32.829802 14498 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:32.829881 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:49:32.830736 14498 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee5b64b894d644a69716f3c25c7f2375" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34065 } }
I20260811 11:49:32.831125 14498 leader_election.cc:302] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee5b64b894d644a69716f3c25c7f2375; no voters:
I20260811 11:49:32.831451 14498 leader_election.cc:288] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:32.831574 14511 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:32.831802 14511 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375 [term 1 LEADER]: Becoming Leader. State: Replica: ee5b64b894d644a69716f3c25c7f2375, State: Running, Role: LEADER
I20260811 11:49:32.832222 14511 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee5b64b894d644a69716f3c25c7f2375" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34065 } }
I20260811 11:49:32.832913 14498 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:32.834023 14512 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee5b64b894d644a69716f3c25c7f2375" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee5b64b894d644a69716f3c25c7f2375" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34065 } } }
I20260811 11:49:32.834141 14512 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:32.834520 14513 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee5b64b894d644a69716f3c25c7f2375. Latest consensus state: current_term: 1 leader_uuid: "ee5b64b894d644a69716f3c25c7f2375" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee5b64b894d644a69716f3c25c7f2375" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34065 } } }
I20260811 11:49:32.834672 14513 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:32.837383 14502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:32.832427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.30:44509 (local address 127.0.0.1:34065)
0811 11:49:32.832545 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:32.832549 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:32.832565 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:49:32.832775 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:32.832779 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:32.832831 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:32.832918 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:32.833343 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:32.834197 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:32.835388 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:32.835746 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:32.835874 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:32.836851 (+ 977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:32.836856 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:32.836865 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:32.836876 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:32.836900 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:32.836911 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:32.837002 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:32.837187 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 11:49:32.837225 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":36}
W20260811 11:49:32.838640 14530 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:49:32.838724 14530 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:49:32.838804 14524 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:32.839766 14524 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:32.845566 14524 catalog_manager.cc:1347] Generated new cluster ID: 853c7a0898bc4f89bbca2e604be469dc
I20260811 11:49:32.845644 14524 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:32.875978 14524 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:32.877099 14524 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:32.881327 14524 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee5b64b894d644a69716f3c25c7f2375: Generated new TSK 0
I20260811 11:49:32.882059 14524 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:49:32.886286 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 14420
W20260811 11:49:32.897063 14402 connection.cc:535] client connection to 127.0.0.1:34065 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34065): Connection reset by peer (error 104)
2026-08-11T11:49:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1595 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:32 dist-test-slave-vkjp krb5kdc[14540](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:32 dist-test-slave-vkjp krb5kdc[14540](info): set up 2 sockets
Aug 11 11:49:32 dist-test-slave-vkjp krb5kdc[14540](info): commencing operation
krb5kdc: starting...
W20260811 11:49:34.040443 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:34 dist-test-slave-vkjp krb5kdc[14540](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448974, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:49:34.176139 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33821
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33821
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:34.292079 14554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:34.292416 14554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:34.292495 14554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:34.296545 14554 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:34.296607 14554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:34.296625 14554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:34.296661 14554 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:34.296694 14554 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:34.302090 14554 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33821
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:34.303294 14554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:34.304301 14554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:49:34.313247 14554 server_base.cc:1034] running on GCE node
W20260811 11:49:34.313184 14560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:34.313194 14564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:34.313256 14561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:34.314148 14554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:34.315358 14554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:34.316574 14554 hybrid_clock.cc:648] HybridClock initialized: now 1786448974316561 us; error 29 us; skew 500 ppm
Aug 11 11:49:34 dist-test-slave-vkjp krb5kdc[14540](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448974, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:34.319643 14554 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:49:34.320506 14554 webserver.cc:460] Webserver started at http://127.0.0.1:38153/ using document root <none> and password file <none>
I20260811 11:49:34.321044 14554 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:34.321106 14554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:34.321285 14554 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:34.323413 14554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "07e79c4a053a423388911df79e690401"
format_stamp: "Formatted at 2026-08-11 11:49:34 on dist-test-slave-vkjp"
server_key: "78f931d2dbe806104d74fbe08aecbb14"
server_key_iv: "9f47d1757cf055e4a33963e298da0afa"
server_key_version: "encryptionkey@0"
I20260811 11:49:34.323935 14554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "07e79c4a053a423388911df79e690401"
format_stamp: "Formatted at 2026-08-11 11:49:34 on dist-test-slave-vkjp"
server_key: "78f931d2dbe806104d74fbe08aecbb14"
server_key_iv: "9f47d1757cf055e4a33963e298da0afa"
server_key_version: "encryptionkey@0"
I20260811 11:49:34.327672 14554 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 11:49:34.330077 14571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:34.331422 14554 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:49:34.331586 14554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "07e79c4a053a423388911df79e690401"
format_stamp: "Formatted at 2026-08-11 11:49:34 on dist-test-slave-vkjp"
server_key: "78f931d2dbe806104d74fbe08aecbb14"
server_key_iv: "9f47d1757cf055e4a33963e298da0afa"
server_key_version: "encryptionkey@0"
I20260811 11:49:34.331684 14554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:34.336340 14554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:34.339525 14554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:34.339730 14554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:34.346848 14554 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33821
I20260811 11:49:34.346943 14632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33821 every 8 connection(s)
I20260811 11:49:34.347909 14554 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:34.351166 14634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:34.353461 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 14554
I20260811 11:49:34.353641 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:34.353945 21457 external_mini_cluster.cc:1428] Setting key 52d31bf8f1c22c3a675ed1caa0c6913e
I20260811 11:49:34.359347 14634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401: Bootstrap starting.
I20260811 11:49:34.360335 14637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:34.355587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.30:58353 (local address 127.0.0.1:33821)
0811 11:49:34.356095 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:34.356119 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:34.356170 (+ 51us) server_negotiation.cc:407] Connection header received
0811 11:49:34.357053 (+ 883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:34.357080 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:34.357515 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:34.357968 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:34.358707 (+ 739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:34.358713 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:34.358729 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:34.358741 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:34.358804 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:34.358833 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:34.358986 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:34.359064 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 11:49:34.359271 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":138,"threads_started":1}
I20260811 11:49:34.362278 14634 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:34.363300 14634 log.cc:824] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:34.363521 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:49:34.365950 14634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401: No bootstrap required, opened a new log
I20260811 11:49:34.367888 14637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:34.366011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.30:47417 (local address 127.0.0.1:33821)
0811 11:49:34.366143 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:34.366148 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:34.366348 (+ 200us) server_negotiation.cc:407] Connection header received
0811 11:49:34.366431 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:34.366434 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:34.366473 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:34.366569 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:34.367354 (+ 785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:34.367358 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:34.367361 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:34.367373 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:34.367406 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:34.367421 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:34.367528 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:34.367709 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 11:49:34.367755 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 11:49:34.370793 14634 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e79c4a053a423388911df79e690401" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33821 } }
I20260811 11:49:34.371140 14634 raft_consensus.cc:374] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:34.371201 14634 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07e79c4a053a423388911df79e690401, State: Initialized, Role: FOLLOWER
I20260811 11:49:34.371629 14634 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e79c4a053a423388911df79e690401" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33821 } }
I20260811 11:49:34.371758 14634 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:34.371815 14634 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:34.371897 14634 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:34.372961 14634 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e79c4a053a423388911df79e690401" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33821 } }
I20260811 11:49:34.373338 14634 leader_election.cc:302] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07e79c4a053a423388911df79e690401; no voters:
I20260811 11:49:34.373821 14634 leader_election.cc:288] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:34.373895 14644 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:34.374161 14644 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401 [term 1 LEADER]: Becoming Leader. State: Replica: 07e79c4a053a423388911df79e690401, State: Running, Role: LEADER
I20260811 11:49:34.374567 14644 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e79c4a053a423388911df79e690401" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33821 } }
I20260811 11:49:34.375363 14634 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:34.376801 14647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07e79c4a053a423388911df79e690401. Latest consensus state: current_term: 1 leader_uuid: "07e79c4a053a423388911df79e690401" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e79c4a053a423388911df79e690401" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33821 } } }
I20260811 11:49:34.376839 14645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07e79c4a053a423388911df79e690401" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e79c4a053a423388911df79e690401" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33821 } } }
I20260811 11:49:34.377043 14647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:34.377074 14645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:34.377514 14657 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:34.381175 14657 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:34.386953 14657 catalog_manager.cc:1347] Generated new cluster ID: fba084be84dc4b18b514ab25a73dfe5d
I20260811 11:49:34.387126 14657 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:34.411607 14657 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:34.412037 14657 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:34.418957 14657 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 07e79c4a053a423388911df79e690401: Generated new TSK 0
I20260811 11:49:34.419718 14657 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:49:34.423821 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 14554
2026-08-11T11:49:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1538 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:34 dist-test-slave-vkjp krb5kdc[14670](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:34 dist-test-slave-vkjp krb5kdc[14670](info): set up 2 sockets
Aug 11 11:49:34 dist-test-slave-vkjp krb5kdc[14670](info): commencing operation
krb5kdc: starting...
W20260811 11:49:35.578083 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:35 dist-test-slave-vkjp krb5kdc[14670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448975, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:49:35.726269 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46131
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46131
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:35.840438 14683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:35.840762 14683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:35.840838 14683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:35.844879 14683 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:35.844975 14683 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:35.845021 14683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:35.845083 14683 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:35.845122 14683 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:35.850651 14683 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46131
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14683
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:35.851902 14683 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:35.853019 14683 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:35.861958 14692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:35.861915 14689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:35.861915 14690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:35.862303 14683 server_base.cc:1034] running on GCE node
I20260811 11:49:35.862975 14683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:35.864178 14683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:35.865342 14683 hybrid_clock.cc:648] HybridClock initialized: now 1786448975865316 us; error 35 us; skew 500 ppm
Aug 11 11:49:35 dist-test-slave-vkjp krb5kdc[14670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448975, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:35.868274 14683 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:49:35.869256 14683 webserver.cc:460] Webserver started at http://127.0.0.1:42313/ using document root <none> and password file <none>
I20260811 11:49:35.869833 14683 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:35.869927 14683 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:35.870172 14683 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:35.872308 14683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "cb6a757391b04e91807ed3744dbfcb4e"
format_stamp: "Formatted at 2026-08-11 11:49:35 on dist-test-slave-vkjp"
server_key: "a5ed9927263993db21c1f08d94eaae2d"
server_key_iv: "279627dd54fe935da382729a81145aa1"
server_key_version: "encryptionkey@0"
I20260811 11:49:35.872920 14683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "cb6a757391b04e91807ed3744dbfcb4e"
format_stamp: "Formatted at 2026-08-11 11:49:35 on dist-test-slave-vkjp"
server_key: "a5ed9927263993db21c1f08d94eaae2d"
server_key_iv: "279627dd54fe935da382729a81145aa1"
server_key_version: "encryptionkey@0"
I20260811 11:49:35.876873 14683 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 11:49:35.879659 14700 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:35.881017 14683 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:49:35.881184 14683 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "cb6a757391b04e91807ed3744dbfcb4e"
format_stamp: "Formatted at 2026-08-11 11:49:35 on dist-test-slave-vkjp"
server_key: "a5ed9927263993db21c1f08d94eaae2d"
server_key_iv: "279627dd54fe935da382729a81145aa1"
server_key_version: "encryptionkey@0"
I20260811 11:49:35.881312 14683 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:35.893803 14683 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:35.897022 14683 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:35.897282 14683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:35.905560 14683 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46131
I20260811 11:49:35.905591 14759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46131 every 8 connection(s)
I20260811 11:49:35.906689 14683 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:35.910156 14760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:35.913990 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 14683
I20260811 11:49:35.914145 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:35.914415 21457 external_mini_cluster.cc:1428] Setting key 8fc7b30d0c13b9f10bebdaa7bec08407
I20260811 11:49:35.916494 14760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e: Bootstrap starting.
I20260811 11:49:35.918731 14760 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:35.919572 14760 log.cc:824] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:35.922174 14760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e: No bootstrap required, opened a new log
Aug 11 11:49:35 dist-test-slave-vkjp krb5kdc[14670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448975, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 11:49:35.926942 14760 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb6a757391b04e91807ed3744dbfcb4e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46131 } }
I20260811 11:49:35.927356 14760 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:35.927445 14760 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb6a757391b04e91807ed3744dbfcb4e, State: Initialized, Role: FOLLOWER
I20260811 11:49:35.928006 14760 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb6a757391b04e91807ed3744dbfcb4e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46131 } }
I20260811 11:49:35.928241 14760 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:35.928355 14760 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:35.928470 14760 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:35.929818 14760 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb6a757391b04e91807ed3744dbfcb4e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46131 } }
I20260811 11:49:35.930263 14760 leader_election.cc:302] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb6a757391b04e91807ed3744dbfcb4e; no voters:
I20260811 11:49:35.930694 14760 leader_election.cc:288] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:35.930821 14766 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:35.931134 14766 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e [term 1 LEADER]: Becoming Leader. State: Replica: cb6a757391b04e91807ed3744dbfcb4e, State: Running, Role: LEADER
I20260811 11:49:35.931517 14766 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb6a757391b04e91807ed3744dbfcb4e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46131 } }
I20260811 11:49:35.931681 14763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:35.915946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.30:38229 (local address 127.0.0.1:46131)
0811 11:49:35.916419 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:35.916435 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:35.916471 (+ 36us) server_negotiation.cc:407] Connection header received
0811 11:49:35.917205 (+ 734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:35.917223 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:35.917580 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:35.917924 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:35.918770 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:35.919993 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:35.921202 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:35.921666 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:35.921789 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:35.924923 (+ 3134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:35.924930 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:35.924948 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:35.924986 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:35.927919 (+ 2933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:35.928537 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:35.928545 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:35.928552 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:35.928727 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:35.929106 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:35.929109 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:35.929111 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:35.929702 (+ 591us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:35.929966 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:35.930302 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 11:49:35.930564 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":150,"threads_started":1}
I20260811 11:49:35.932148 14760 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:35.933588 14768 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb6a757391b04e91807ed3744dbfcb4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb6a757391b04e91807ed3744dbfcb4e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46131 } } }
I20260811 11:49:35.933710 14768 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:35.934773 14778 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:35.935235 14770 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb6a757391b04e91807ed3744dbfcb4e. Latest consensus state: current_term: 1 leader_uuid: "cb6a757391b04e91807ed3744dbfcb4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb6a757391b04e91807ed3744dbfcb4e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46131 } } }
I20260811 11:49:35.935457 14770 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:35.935530 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:49:35.938339 14778 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:35.945035 14778 catalog_manager.cc:1347] Generated new cluster ID: 01a681789b6440bab2e7dbe7134c80f4
I20260811 11:49:35.945169 14778 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:35.946696 14763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:35.937426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.30:53939 (local address 127.0.0.1:46131)
0811 11:49:35.937542 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:35.937546 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:35.937789 (+ 243us) server_negotiation.cc:407] Connection header received
0811 11:49:35.937934 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:35.937937 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:35.937992 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:35.938077 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:35.938804 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:35.939400 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:35.940229 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:35.940517 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:35.940617 (+ 100us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:35.942586 (+ 1969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:35.942590 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:35.942593 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:35.942621 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:35.944554 (+ 1933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:35.945147 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:35.945151 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:35.945153 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:35.945288 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:35.945689 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:35.945693 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:35.945695 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:35.945942 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:35.946114 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:35.946409 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 11:49:35.946521 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 11:49:35.973932 14778 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:35.975428 14778 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:35.981669 14778 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb6a757391b04e91807ed3744dbfcb4e: Generated new TSK 0
I20260811 11:49:35.982419 14778 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:49:35.991613 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 14683
W20260811 11:49:36.003121 14668 connection.cc:535] client connection to 127.0.0.1:46131 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46131): Connection reset by peer (error 104)
2026-08-11T11:49:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1567 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:36 dist-test-slave-vkjp krb5kdc[14797](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:36 dist-test-slave-vkjp krb5kdc[14797](info): set up 2 sockets
Aug 11 11:49:36 dist-test-slave-vkjp krb5kdc[14797](info): commencing operation
krb5kdc: starting...
W20260811 11:49:37.133140 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:37 dist-test-slave-vkjp krb5kdc[14797](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:49:37.270994 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35775
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35775
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:37.396800 14814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:37.397156 14814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:37.397256 14814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:37.401486 14814 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:37.401592 14814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:37.401630 14814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:37.401669 14814 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:37.401701 14814 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:37.407069 14814 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35775
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:37.408386 14814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:37.409503 14814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:37.418632 14823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:37.418632 14820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:37.418632 14821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:37.418879 14814 server_base.cc:1034] running on GCE node
I20260811 11:49:37.419739 14814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:37.420928 14814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:37.422147 14814 hybrid_clock.cc:648] HybridClock initialized: now 1786448977422127 us; error 44 us; skew 500 ppm
Aug 11 11:49:37 dist-test-slave-vkjp krb5kdc[14797](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448977, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:37.430778 14814 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:49:37.431921 14814 webserver.cc:460] Webserver started at http://127.0.0.1:44159/ using document root <none> and password file <none>
I20260811 11:49:37.432498 14814 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:37.432561 14814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:37.432744 14814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:37.434876 14814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "bc0bcc6718054d23b4f44a7f8bed2c12"
format_stamp: "Formatted at 2026-08-11 11:49:37 on dist-test-slave-vkjp"
server_key: "a393cc8e85f222084f6b93f28fc53e02"
server_key_iv: "10ad34be979b5dc1701fff589738afda"
server_key_version: "encryptionkey@0"
I20260811 11:49:37.435528 14814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "bc0bcc6718054d23b4f44a7f8bed2c12"
format_stamp: "Formatted at 2026-08-11 11:49:37 on dist-test-slave-vkjp"
server_key: "a393cc8e85f222084f6b93f28fc53e02"
server_key_iv: "10ad34be979b5dc1701fff589738afda"
server_key_version: "encryptionkey@0"
I20260811 11:49:37.439465 14814 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 11:49:37.442049 14833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:37.443534 14814 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:49:37.443643 14814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "bc0bcc6718054d23b4f44a7f8bed2c12"
format_stamp: "Formatted at 2026-08-11 11:49:37 on dist-test-slave-vkjp"
server_key: "a393cc8e85f222084f6b93f28fc53e02"
server_key_iv: "10ad34be979b5dc1701fff589738afda"
server_key_version: "encryptionkey@0"
I20260811 11:49:37.443742 14814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:37.458230 14814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:37.461184 14814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:37.461346 14814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:37.468660 14814 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35775
I20260811 11:49:37.468690 14893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35775 every 8 connection(s)
I20260811 11:49:37.469642 14814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:37.472473 14896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:37.478183 14896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12: Bootstrap starting.
I20260811 11:49:37.479260 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 14814
I20260811 11:49:37.479403 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:37.479768 21457 external_mini_cluster.cc:1428] Setting key 89b9e6a4afd808226541b9d8a5ef1428
I20260811 11:49:37.481333 14896 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:37.482131 14896 log.cc:824] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:37.484355 14896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12: No bootstrap required, opened a new log
I20260811 11:49:37.489192 14896 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc0bcc6718054d23b4f44a7f8bed2c12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35775 } }
I20260811 11:49:37.489578 14896 raft_consensus.cc:374] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:37.489645 14896 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc0bcc6718054d23b4f44a7f8bed2c12, State: Initialized, Role: FOLLOWER
I20260811 11:49:37.489996 14900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:37.480947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.30:34357 (local address 127.0.0.1:35775)
0811 11:49:37.481458 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:37.481486 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:37.481524 (+ 38us) server_negotiation.cc:407] Connection header received
0811 11:49:37.482220 (+ 696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:37.482247 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:37.482686 (+ 439us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:37.483063 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:37.483464 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:37.484494 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:37.485728 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:37.486224 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:37.486358 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:37.487329 (+ 971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:37.487334 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:37.487347 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:37.487942 (+ 595us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:37.488021 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:37.488057 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:37.488219 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:37.488659 (+ 440us) server_negotiation.cc:299] Negotiation successful
0811 11:49:37.488851 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":137,"threads_started":1}
I20260811 11:49:37.490237 14896 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc0bcc6718054d23b4f44a7f8bed2c12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35775 } }
I20260811 11:49:37.490419 14896 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:37.490535 14896 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:37.490669 14896 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:37.491796 14896 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc0bcc6718054d23b4f44a7f8bed2c12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35775 } }
I20260811 11:49:37.492197 14896 leader_election.cc:302] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc0bcc6718054d23b4f44a7f8bed2c12; no voters:
I20260811 11:49:37.492571 14896 leader_election.cc:288] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:37.492646 14902 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:37.492913 14902 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12 [term 1 LEADER]: Becoming Leader. State: Replica: bc0bcc6718054d23b4f44a7f8bed2c12, State: Running, Role: LEADER
I20260811 11:49:37.493265 14902 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc0bcc6718054d23b4f44a7f8bed2c12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35775 } }
I20260811 11:49:37.493369 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:49:37.493993 14896 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:37.495185 14904 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc0bcc6718054d23b4f44a7f8bed2c12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc0bcc6718054d23b4f44a7f8bed2c12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35775 } } }
I20260811 11:49:37.495306 14904 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:37.495044 14903 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc0bcc6718054d23b4f44a7f8bed2c12. Latest consensus state: current_term: 1 leader_uuid: "bc0bcc6718054d23b4f44a7f8bed2c12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc0bcc6718054d23b4f44a7f8bed2c12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35775 } } }
I20260811 11:49:37.495616 14903 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:37.495720 14918 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:37.499168 14918 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:37.501820 14900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:37.496465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.30:52449 (local address 127.0.0.1:35775)
0811 11:49:37.496585 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:37.496590 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:37.496936 (+ 346us) server_negotiation.cc:407] Connection header received
0811 11:49:37.497115 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:37.497119 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:37.497171 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:37.497224 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:37.497705 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:37.498522 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:37.499700 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:37.500027 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:37.500145 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:37.501152 (+ 1007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:37.501156 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:37.501159 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:37.501173 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:37.501209 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:37.501221 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:37.501360 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:37.501508 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 11:49:37.501703 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 11:49:37.505851 14918 catalog_manager.cc:1347] Generated new cluster ID: e4c36e1fc13f4a0aa8bf78d16e7d61e3
I20260811 11:49:37.505932 14918 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:37.513336 14918 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:37.514349 14918 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:37.522140 14918 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bc0bcc6718054d23b4f44a7f8bed2c12: Generated new TSK 0
I20260811 11:49:37.522907 14918 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:49:37.530637 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 14814
W20260811 11:49:37.541970 14795 connection.cc:535] client connection to 127.0.0.1:35775 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35775): Connection reset by peer (error 104)
2026-08-11T11:49:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1538 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:37 dist-test-slave-vkjp krb5kdc[14937](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:37 dist-test-slave-vkjp krb5kdc[14937](info): set up 2 sockets
Aug 11 11:49:37 dist-test-slave-vkjp krb5kdc[14937](info): commencing operation
krb5kdc: starting...
W20260811 11:49:38.675598 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:38 dist-test-slave-vkjp krb5kdc[14937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:49:38.818374 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41339
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41339
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:38.938807 14951 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:38.939188 14951 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:38.939306 14951 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:38.943660 14951 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:38.943756 14951 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:38.943796 14951 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:38.943854 14951 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:38.943892 14951 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:38.949677 14951 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41339
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14951
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:38.950945 14951 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:38.952133 14951 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:38.961951 14962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:38.961963 14959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:38.962282 14951 server_base.cc:1034] running on GCE node
W20260811 11:49:38.961951 14960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:38.963054 14951 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:38.964373 14951 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:38.965649 14951 hybrid_clock.cc:648] HybridClock initialized: now 1786448978965589 us; error 38 us; skew 500 ppm
Aug 11 11:49:38 dist-test-slave-vkjp krb5kdc[14937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448978, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:38.968819 14951 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:49:38.969805 14951 webserver.cc:460] Webserver started at http://127.0.0.1:38497/ using document root <none> and password file <none>
I20260811 11:49:38.970383 14951 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:38.970446 14951 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:38.970649 14951 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:38.973026 14951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "82c1b7cd406d4fd8af44978900818e73"
format_stamp: "Formatted at 2026-08-11 11:49:38 on dist-test-slave-vkjp"
server_key: "508547a178c643428ae5c0a5d5e620b1"
server_key_iv: "020225bc343f40fe2c02fc47b9b9ff73"
server_key_version: "encryptionkey@0"
I20260811 11:49:38.973596 14951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "82c1b7cd406d4fd8af44978900818e73"
format_stamp: "Formatted at 2026-08-11 11:49:38 on dist-test-slave-vkjp"
server_key: "508547a178c643428ae5c0a5d5e620b1"
server_key_iv: "020225bc343f40fe2c02fc47b9b9ff73"
server_key_version: "encryptionkey@0"
I20260811 11:49:38.978438 14951 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260811 11:49:38.981278 14971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:38.982724 14951 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 11:49:38.982903 14951 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "82c1b7cd406d4fd8af44978900818e73"
format_stamp: "Formatted at 2026-08-11 11:49:38 on dist-test-slave-vkjp"
server_key: "508547a178c643428ae5c0a5d5e620b1"
server_key_iv: "020225bc343f40fe2c02fc47b9b9ff73"
server_key_version: "encryptionkey@0"
I20260811 11:49:38.983045 14951 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:38.988221 14951 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:38.991634 14951 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:38.991858 14951 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:39.000152 14951 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41339
I20260811 11:49:39.000185 15033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41339 every 8 connection(s)
I20260811 11:49:39.001271 14951 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:39.004397 15034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:39.006744 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 14951
I20260811 11:49:39.006923 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:39.007300 21457 external_mini_cluster.cc:1428] Setting key 7aaf6d8b52ec6968a0cfea8fffcc0a9b
I20260811 11:49:39.011071 15034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73: Bootstrap starting.
I20260811 11:49:39.013160 15038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:39.008908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.30:33657 (local address 127.0.0.1:41339)
0811 11:49:39.009458 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:39.009476 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:39.009542 (+ 66us) server_negotiation.cc:407] Connection header received
0811 11:49:39.010231 (+ 689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:39.010249 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:39.010593 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:39.011021 (+ 428us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:39.011810 (+ 789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:39.011816 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:39.011840 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:39.011850 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:39.011901 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:39.011921 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:39.012083 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:39.012187 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 11:49:39.012361 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":187,"threads_started":1}
I20260811 11:49:39.014127 15034 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:39.015120 15034 log.cc:824] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:39.016398 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:49:39.017632 15034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73: No bootstrap required, opened a new log
I20260811 11:49:39.020586 15038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:39.018662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.30:43237 (local address 127.0.0.1:41339)
0811 11:49:39.018809 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:39.018814 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:39.019040 (+ 226us) server_negotiation.cc:407] Connection header received
0811 11:49:39.019212 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:39.019215 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:39.019247 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:39.019317 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:39.020145 (+ 828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:39.020148 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:39.020150 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:39.020161 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:39.020188 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:39.020199 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:39.020299 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:39.020390 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 11:49:39.020426 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 11:49:39.022781 15034 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82c1b7cd406d4fd8af44978900818e73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41339 } }
I20260811 11:49:39.023090 15034 raft_consensus.cc:374] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:39.023185 15034 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82c1b7cd406d4fd8af44978900818e73, State: Initialized, Role: FOLLOWER
I20260811 11:49:39.023636 15034 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82c1b7cd406d4fd8af44978900818e73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41339 } }
I20260811 11:49:39.023818 15034 raft_consensus.cc:388] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:39.023913 15034 raft_consensus.cc:482] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:39.024071 15034 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:39.025236 15034 raft_consensus.cc:504] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82c1b7cd406d4fd8af44978900818e73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41339 } }
I20260811 11:49:39.025626 15034 leader_election.cc:302] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82c1b7cd406d4fd8af44978900818e73; no voters:
I20260811 11:49:39.026010 15034 leader_election.cc:288] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:39.026201 15045 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:39.026473 15045 raft_consensus.cc:686] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73 [term 1 LEADER]: Becoming Leader. State: Replica: 82c1b7cd406d4fd8af44978900818e73, State: Running, Role: LEADER
I20260811 11:49:39.026906 15045 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82c1b7cd406d4fd8af44978900818e73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41339 } }
I20260811 11:49:39.027544 15034 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:39.028741 15047 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82c1b7cd406d4fd8af44978900818e73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82c1b7cd406d4fd8af44978900818e73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41339 } } }
I20260811 11:49:39.028893 15047 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:39.029235 15048 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82c1b7cd406d4fd8af44978900818e73. Latest consensus state: current_term: 1 leader_uuid: "82c1b7cd406d4fd8af44978900818e73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82c1b7cd406d4fd8af44978900818e73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41339 } } }
I20260811 11:49:39.029328 15048 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:39.029439 15055 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:39.033041 15055 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:39.039247 15055 catalog_manager.cc:1347] Generated new cluster ID: bc348c61cffb426c85c17bf28bb70933
I20260811 11:49:39.039330 15055 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:39.050741 15055 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:39.051160 15055 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:39.058295 15055 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 82c1b7cd406d4fd8af44978900818e73: Generated new TSK 0
I20260811 11:49:39.059412 15055 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:49:39.063567 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 14951
2026-08-11T11:49:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1531 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:39 dist-test-slave-vkjp krb5kdc[15069](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:39 dist-test-slave-vkjp krb5kdc[15069](info): set up 2 sockets
Aug 11 11:49:39 dist-test-slave-vkjp krb5kdc[15069](info): commencing operation
krb5kdc: starting...
W20260811 11:49:40.197678 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:40 dist-test-slave-vkjp krb5kdc[15069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:49:40.334440 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:44907
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:40675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:44907
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:40.457067 15082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:40.457399 15082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:40.457484 15082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:40.461773 15082 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:40.461872 15082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:40.461911 15082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:40.461948 15082 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:40.461982 15082 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:40.467557 15082 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:40675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:44907
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:44907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:40.468726 15082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:40.469813 15082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:49:40.478955 15082 server_base.cc:1034] running on GCE node
W20260811 11:49:40.478982 15088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:40.479163 15089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:40.478982 15091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:40.479871 15082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:40.481071 15082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:40.482268 15082 hybrid_clock.cc:648] HybridClock initialized: now 1786448980482250 us; error 45 us; skew 500 ppm
Aug 11 11:49:40 dist-test-slave-vkjp krb5kdc[15069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448980, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:40.485970 15082 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:49:40.487366 15082 webserver.cc:460] Webserver started at http://127.20.244.126:44549/ using document root <none> and password file <none>
I20260811 11:49:40.488461 15082 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:40.488559 15082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:40.488862 15082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:40.492904 15082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "8b221f94ee35468aa7c55a72d7e3adb2"
format_stamp: "Formatted at 2026-08-11 11:49:40 on dist-test-slave-vkjp"
server_key: "9b1211f4db67019a1f5bf3b782d4ab32"
server_key_iv: "f8b462f099795c299a746d90699db2f6"
server_key_version: "encryptionkey@0"
I20260811 11:49:40.494036 15082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "8b221f94ee35468aa7c55a72d7e3adb2"
format_stamp: "Formatted at 2026-08-11 11:49:40 on dist-test-slave-vkjp"
server_key: "9b1211f4db67019a1f5bf3b782d4ab32"
server_key_iv: "f8b462f099795c299a746d90699db2f6"
server_key_version: "encryptionkey@0"
I20260811 11:49:40.501924 15082 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.007s sys 0.001s
I20260811 11:49:40.507597 15101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:40.509322 15082 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260811 11:49:40.509513 15082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "8b221f94ee35468aa7c55a72d7e3adb2"
format_stamp: "Formatted at 2026-08-11 11:49:40 on dist-test-slave-vkjp"
server_key: "9b1211f4db67019a1f5bf3b782d4ab32"
server_key_iv: "f8b462f099795c299a746d90699db2f6"
server_key_version: "encryptionkey@0"
I20260811 11:49:40.509678 15082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:40.529384 15082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:40.533142 15082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:40.533305 15082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:40.541273 15082 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:44907
I20260811 11:49:40.541296 15161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:44907 every 8 connection(s)
I20260811 11:49:40.542279 15082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:40.542649 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 15082
I20260811 11:49:40.542816 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:40.543249 21457 external_mini_cluster.cc:1428] Setting key b1383bdef14d2bb03571d99da8fe8118
I20260811 11:49:40.545529 15162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:40.552439 15162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2: Bootstrap starting.
Aug 11 11:49:40 dist-test-slave-vkjp krb5kdc[15069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:49:40.554803 15162 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:40.555696 15162 log.cc:824] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:40.557668 15162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2: No bootstrap required, opened a new log
I20260811 11:49:40.558557 15165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:40.544973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38127 (local address 127.20.244.126:44907)
0811 11:49:40.545384 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:40.545403 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:40.545456 (+ 53us) server_negotiation.cc:407] Connection header received
0811 11:49:40.546138 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:40.546154 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:40.546489 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:40.546762 (+ 273us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:40.547791 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:40.548810 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:40.549965 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:40.550430 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:40.550545 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:40.553576 (+ 3031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:40.553582 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:40.553594 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:40.553624 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:40.555532 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:40.556135 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:40.556141 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:40.556145 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:40.556257 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:40.556609 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:40.556618 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:40.556619 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:40.557015 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:40.557239 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:40.557576 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 11:49:40.557846 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":146,"threads_started":1}
I20260811 11:49:40.560794 15162 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b221f94ee35468aa7c55a72d7e3adb2" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 44907 } }
I20260811 11:49:40.561062 15162 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:40.561138 15162 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b221f94ee35468aa7c55a72d7e3adb2, State: Initialized, Role: FOLLOWER
I20260811 11:49:40.561586 15162 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b221f94ee35468aa7c55a72d7e3adb2" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 44907 } }
I20260811 11:49:40.561740 15162 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:40.561821 15162 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:40.561969 15162 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:40.562119 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:49:40.562988 15162 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b221f94ee35468aa7c55a72d7e3adb2" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 44907 } }
I20260811 11:49:40.563377 15162 leader_election.cc:302] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b221f94ee35468aa7c55a72d7e3adb2; no voters:
I20260811 11:49:40.563726 15162 leader_election.cc:288] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:40.563864 15172 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:40.564587 15172 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2 [term 1 LEADER]: Becoming Leader. State: Replica: 8b221f94ee35468aa7c55a72d7e3adb2, State: Running, Role: LEADER
I20260811 11:49:40.564910 15172 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b221f94ee35468aa7c55a72d7e3adb2" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 44907 } }
I20260811 11:49:40.565119 15162 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:40.566084 15172 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b221f94ee35468aa7c55a72d7e3adb2. Latest consensus state: current_term: 1 leader_uuid: "8b221f94ee35468aa7c55a72d7e3adb2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b221f94ee35468aa7c55a72d7e3adb2" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 44907 } } }
I20260811 11:49:40.566203 15172 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:40.566558 15186 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:40.566571 15176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b221f94ee35468aa7c55a72d7e3adb2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b221f94ee35468aa7c55a72d7e3adb2" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 44907 } } }
I20260811 11:49:40.566692 15176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:40.569664 15186 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:40.574173 15165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:40.564335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44897 (local address 127.20.244.126:44907)
0811 11:49:40.564453 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:40.564458 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:40.564617 (+ 159us) server_negotiation.cc:407] Connection header received
0811 11:49:40.564852 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:40.564855 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:40.564903 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:40.564999 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:40.565901 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:40.566685 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:40.567949 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:40.568310 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:40.568411 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:40.570117 (+ 1706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:40.570121 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:40.570123 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:40.570150 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:40.571855 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:40.572493 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:40.572497 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:40.572499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:40.572587 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:40.573008 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:40.573012 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:40.573014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:40.573242 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:40.573483 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:40.573896 (+ 413us) server_negotiation.cc:299] Negotiation successful
0811 11:49:40.574009 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 11:49:40.583488 15186 catalog_manager.cc:1347] Generated new cluster ID: 53177cf326f74608811e702d75fa3541
I20260811 11:49:40.583588 15186 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:40.600567 15186 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:40.601948 15186 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:40.618187 15186 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b221f94ee35468aa7c55a72d7e3adb2: Generated new TSK 0
I20260811 11:49:40.619261 15186 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:49:40.630939 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 15082
W20260811 11:49:40.642413 15067 connection.cc:535] client connection to 127.20.244.126:44907 recv error: Network error: failed to read from TLS socket (remote: 127.20.244.126:44907): Connection reset by peer (error 104)
2026-08-11T11:49:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1568 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:40 dist-test-slave-vkjp krb5kdc[15199](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:40 dist-test-slave-vkjp krb5kdc[15199](info): set up 2 sockets
Aug 11 11:49:40 dist-test-slave-vkjp krb5kdc[15199](info): commencing operation
krb5kdc: starting...
W20260811 11:49:41.865001 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.208s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:41 dist-test-slave-vkjp krb5kdc[15199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448981, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:49:42.005496 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:38047
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:41399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:38047
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:42.125515 15212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:42.125819 15212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:42.125867 15212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:42.130100 15212 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:42.130184 15212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:42.130208 15212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:42.130228 15212 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:42.130277 15212 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:42.135914 15212 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:41399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:38047
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:38047
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:42.137123 15212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:42.138231 15212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:42.147202 15221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:42.147209 15219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:42.147423 15212 server_base.cc:1034] running on GCE node
W20260811 11:49:42.147230 15218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:42.148051 15212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:42.149253 15212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:42.150465 15212 hybrid_clock.cc:648] HybridClock initialized: now 1786448982150433 us; error 42 us; skew 500 ppm
Aug 11 11:49:42 dist-test-slave-vkjp krb5kdc[15199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448982, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:42.153530 15212 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:49:42.154510 15212 webserver.cc:460] Webserver started at http://127.20.244.126:39567/ using document root <none> and password file <none>
I20260811 11:49:42.155148 15212 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:42.155246 15212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:42.155503 15212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:42.157681 15212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "f8f477bb1a0441d8a9222804eec42786"
format_stamp: "Formatted at 2026-08-11 11:49:42 on dist-test-slave-vkjp"
server_key: "8fa8a003822e7b570a041d48cdfcc448"
server_key_iv: "fd8bdfa1dcb2412b49043b18be6311f6"
server_key_version: "encryptionkey@0"
I20260811 11:49:42.158283 15212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "f8f477bb1a0441d8a9222804eec42786"
format_stamp: "Formatted at 2026-08-11 11:49:42 on dist-test-slave-vkjp"
server_key: "8fa8a003822e7b570a041d48cdfcc448"
server_key_iv: "fd8bdfa1dcb2412b49043b18be6311f6"
server_key_version: "encryptionkey@0"
I20260811 11:49:42.162413 15212 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 11:49:42.165094 15229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:42.166380 15212 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:49:42.166555 15212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "f8f477bb1a0441d8a9222804eec42786"
format_stamp: "Formatted at 2026-08-11 11:49:42 on dist-test-slave-vkjp"
server_key: "8fa8a003822e7b570a041d48cdfcc448"
server_key_iv: "fd8bdfa1dcb2412b49043b18be6311f6"
server_key_version: "encryptionkey@0"
I20260811 11:49:42.166677 15212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:42.204738 15212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:42.208169 15212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:42.208395 15212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:42.216212 15212 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:38047
I20260811 11:49:42.216239 15287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:38047 every 8 connection(s)
I20260811 11:49:42.217203 15212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:42.220188 15289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:42.223827 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 15212
I20260811 11:49:42.223995 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:42.224328 21457 external_mini_cluster.cc:1428] Setting key a5828a29a804517d202e3762e7d6ee62
I20260811 11:49:42.226504 15289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786: Bootstrap starting.
I20260811 11:49:42.228852 15289 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:42.229619 15289 log.cc:824] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:42.231776 15289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786: No bootstrap required, opened a new log
I20260811 11:49:42.233810 15292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:42.225864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41535 (local address 127.20.244.126:38047)
0811 11:49:42.226326 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:42.226342 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:42.226378 (+ 36us) server_negotiation.cc:407] Connection header received
0811 11:49:42.227112 (+ 734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:42.227132 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:42.227483 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:42.227820 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:42.228257 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:42.229324 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:42.230282 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:42.230772 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:42.230947 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:42.231907 (+ 960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:42.231914 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:42.231931 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:42.232330 (+ 399us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:42.232385 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:42.232417 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:42.232558 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:42.232743 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 11:49:42.232884 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":141,"threads_started":1}
I20260811 11:49:42.235280 15289 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8f477bb1a0441d8a9222804eec42786" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 38047 } }
I20260811 11:49:42.235544 15289 raft_consensus.cc:374] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:42.235637 15289 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8f477bb1a0441d8a9222804eec42786, State: Initialized, Role: FOLLOWER
I20260811 11:49:42.236099 15289 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8f477bb1a0441d8a9222804eec42786" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 38047 } }
I20260811 11:49:42.236228 15289 raft_consensus.cc:388] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:42.236354 15289 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:42.236479 15289 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:42.236931 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:49:42.237515 15289 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8f477bb1a0441d8a9222804eec42786" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 38047 } }
I20260811 11:49:42.237866 15289 leader_election.cc:302] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f8f477bb1a0441d8a9222804eec42786; no voters:
I20260811 11:49:42.238207 15289 leader_election.cc:288] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:42.238278 15296 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:42.238523 15296 raft_consensus.cc:686] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786 [term 1 LEADER]: Becoming Leader. State: Replica: f8f477bb1a0441d8a9222804eec42786, State: Running, Role: LEADER
I20260811 11:49:42.238888 15296 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8f477bb1a0441d8a9222804eec42786" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 38047 } }
I20260811 11:49:42.239735 15289 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:42.240722 15304 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8f477bb1a0441d8a9222804eec42786. Latest consensus state: current_term: 1 leader_uuid: "f8f477bb1a0441d8a9222804eec42786" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8f477bb1a0441d8a9222804eec42786" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 38047 } } }
I20260811 11:49:42.240701 15303 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f8f477bb1a0441d8a9222804eec42786" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8f477bb1a0441d8a9222804eec42786" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 38047 } } }
I20260811 11:49:42.240854 15304 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:42.240854 15303 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:42.241283 15307 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:42.244656 15307 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:42.245142 15292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:42.239223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38159 (local address 127.20.244.126:38047)
0811 11:49:42.239360 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:42.239368 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:42.239624 (+ 256us) server_negotiation.cc:407] Connection header received
0811 11:49:42.239775 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:42.239778 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:42.239831 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:42.239916 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:42.240351 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:42.241237 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:42.243051 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:42.243399 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:42.243507 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:42.244570 (+ 1063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:42.244574 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:42.244577 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:42.244590 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:42.244619 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:42.244632 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:42.244722 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:42.244974 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 11:49:42.245011 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 11:49:42.250406 15307 catalog_manager.cc:1347] Generated new cluster ID: b61c6c64b4704293be6fed85cfda21e7
I20260811 11:49:42.250483 15307 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:42.260021 15307 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:42.261300 15307 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:42.267671 15307 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f8f477bb1a0441d8a9222804eec42786: Generated new TSK 0
I20260811 11:49:42.268473 15307 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:49:42.278432 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 15212
W20260811 11:49:42.286247 15197 connection.cc:535] client connection to 127.20.244.126:38047 recv error: Network error: failed to read from TLS socket (remote: 127.20.244.126:38047): Connection reset by peer (error 104)
2026-08-11T11:49:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1643 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:42 dist-test-slave-vkjp krb5kdc[15328](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:42 dist-test-slave-vkjp krb5kdc[15328](info): set up 2 sockets
Aug 11 11:49:42 dist-test-slave-vkjp krb5kdc[15328](info): commencing operation
krb5kdc: starting...
W20260811 11:49:43.413317 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:43 dist-test-slave-vkjp krb5kdc[15328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448983, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:49:43.555325 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:33551
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:45409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:33551
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:43.675925 15344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:43.676235 15344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:43.676313 15344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:43.680400 15344 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:43.680500 15344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:43.680539 15344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:43.680598 15344 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:43.680639 15344 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:43.685958 15344 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:45409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:33551
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:33551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15344
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:43.687134 15344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:43.688154 15344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:43.696650 15352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:43.696655 15354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:43.696669 15351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:43.696803 15344 server_base.cc:1034] running on GCE node
I20260811 11:49:43.697466 15344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:43.698570 15344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:43.699786 15344 hybrid_clock.cc:648] HybridClock initialized: now 1786448983699750 us; error 47 us; skew 500 ppm
Aug 11 11:49:43 dist-test-slave-vkjp krb5kdc[15328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448983, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:43.707167 15344 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:49:43.708110 15344 webserver.cc:460] Webserver started at http://127.20.244.126:43331/ using document root <none> and password file <none>
I20260811 11:49:43.708699 15344 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:43.708793 15344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:43.709038 15344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:43.711172 15344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "7de27c1ce735435081382a2a03a36b26"
format_stamp: "Formatted at 2026-08-11 11:49:43 on dist-test-slave-vkjp"
server_key: "0c07eaad63bbbf59fec4d542a2391e64"
server_key_iv: "2203989a6a528af2444260fb293491b3"
server_key_version: "encryptionkey@0"
I20260811 11:49:43.711783 15344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "7de27c1ce735435081382a2a03a36b26"
format_stamp: "Formatted at 2026-08-11 11:49:43 on dist-test-slave-vkjp"
server_key: "0c07eaad63bbbf59fec4d542a2391e64"
server_key_iv: "2203989a6a528af2444260fb293491b3"
server_key_version: "encryptionkey@0"
I20260811 11:49:43.715647 15344 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 11:49:43.718189 15363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:43.719532 15344 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:49:43.719671 15344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "7de27c1ce735435081382a2a03a36b26"
format_stamp: "Formatted at 2026-08-11 11:49:43 on dist-test-slave-vkjp"
server_key: "0c07eaad63bbbf59fec4d542a2391e64"
server_key_iv: "2203989a6a528af2444260fb293491b3"
server_key_version: "encryptionkey@0"
I20260811 11:49:43.719784 15344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:43.724534 15344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:43.727910 15344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:43.728109 15344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:43.735957 15344 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:33551
I20260811 11:49:43.735987 15420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:33551 every 8 connection(s)
I20260811 11:49:43.736922 15344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:43.740098 15421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:43.743111 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 15344
I20260811 11:49:43.743281 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:43.743604 21457 external_mini_cluster.cc:1428] Setting key 262dc08749919573d4eeff688813344e
I20260811 11:49:43.746435 15421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26: Bootstrap starting.
I20260811 11:49:43.748957 15424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:43.745121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42445 (local address 127.20.244.126:33551)
0811 11:49:43.745578 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:43.745593 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:43.745628 (+ 35us) server_negotiation.cc:407] Connection header received
0811 11:49:43.746277 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:43.746294 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:43.746643 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:43.746977 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:43.747799 (+ 822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:43.747804 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:43.747815 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:43.747826 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:43.747879 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:43.747898 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:43.748048 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:43.748119 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 11:49:43.748284 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":144,"threads_started":1}
I20260811 11:49:43.748971 15421 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:43.749801 15421 log.cc:824] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:43.751909 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:49:43.752089 15421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26: No bootstrap required, opened a new log
I20260811 11:49:43.756671 15424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:43.754254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46879 (local address 127.20.244.126:33551)
0811 11:49:43.754372 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:43.754376 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:43.754824 (+ 448us) server_negotiation.cc:407] Connection header received
0811 11:49:43.754986 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:43.754989 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:43.755058 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:43.755209 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:43.756065 (+ 856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:43.756100 (+ 35us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:43.756104 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:43.756119 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:43.756155 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:43.756199 (+ 44us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:43.756329 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:43.756420 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 11:49:43.756491 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 11:49:43.756981 15421 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7de27c1ce735435081382a2a03a36b26" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33551 } }
I20260811 11:49:43.757292 15421 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:43.757391 15421 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de27c1ce735435081382a2a03a36b26, State: Initialized, Role: FOLLOWER
I20260811 11:49:43.757892 15421 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7de27c1ce735435081382a2a03a36b26" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33551 } }
I20260811 11:49:43.758074 15421 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:43.758144 15421 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:43.758245 15421 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:43.759306 15421 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7de27c1ce735435081382a2a03a36b26" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33551 } }
I20260811 11:49:43.759670 15421 leader_election.cc:302] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7de27c1ce735435081382a2a03a36b26; no voters:
I20260811 11:49:43.760010 15421 leader_election.cc:288] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:43.760133 15433 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:43.760380 15433 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26 [term 1 LEADER]: Becoming Leader. State: Replica: 7de27c1ce735435081382a2a03a36b26, State: Running, Role: LEADER
I20260811 11:49:43.760773 15433 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7de27c1ce735435081382a2a03a36b26" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33551 } }
I20260811 11:49:43.761379 15421 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:43.762722 15435 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7de27c1ce735435081382a2a03a36b26. Latest consensus state: current_term: 1 leader_uuid: "7de27c1ce735435081382a2a03a36b26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7de27c1ce735435081382a2a03a36b26" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33551 } } }
I20260811 11:49:43.762871 15435 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:43.762871 15434 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7de27c1ce735435081382a2a03a36b26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7de27c1ce735435081382a2a03a36b26" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33551 } } }
I20260811 11:49:43.763010 15434 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26 [sys.catalog]: This master's current role is: LEADER
W20260811 11:49:43.766474 15451 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:49:43.766556 15451 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:49:43.766642 15447 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:43.767489 15447 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:43.773375 15447 catalog_manager.cc:1347] Generated new cluster ID: 4d03e6704bc0446eac8081bcf4b65ab4
I20260811 11:49:43.773447 15447 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:43.790131 15447 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:43.790498 15447 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:43.800454 15447 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7de27c1ce735435081382a2a03a36b26: Generated new TSK 0
I20260811 11:49:43.801317 15447 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:49:43.811491 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 15344
2026-08-11T11:49:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1534 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:43 dist-test-slave-vkjp krb5kdc[15460](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:43 dist-test-slave-vkjp krb5kdc[15460](info): set up 2 sockets
Aug 11 11:49:43 dist-test-slave-vkjp krb5kdc[15460](info): commencing operation
krb5kdc: starting...
W20260811 11:49:44.963817 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:45 dist-test-slave-vkjp krb5kdc[15460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448985, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:49:45.103495 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:33721
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:42553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:33721
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:45.218027 15475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:45.218329 15475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:45.218374 15475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:45.223239 15475 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:45.223317 15475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:45.223341 15475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:45.223358 15475 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:45.223373 15475 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:45.229215 15475 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:42553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:33721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:33721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15475
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:45.230425 15475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:45.231614 15475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:45.240712 15484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:45.240736 15486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:45.240764 15483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:45.240937 15475 server_base.cc:1034] running on GCE node
I20260811 11:49:45.241603 15475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:45.242681 15475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:45.243860 15475 hybrid_clock.cc:648] HybridClock initialized: now 1786448985243842 us; error 30 us; skew 500 ppm
Aug 11 11:49:45 dist-test-slave-vkjp krb5kdc[15460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448985, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:45.246614 15475 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:49:45.247542 15475 webserver.cc:460] Webserver started at http://127.20.244.126:35323/ using document root <none> and password file <none>
I20260811 11:49:45.248081 15475 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:45.248139 15475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:45.248306 15475 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:45.250365 15475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "fda59265a04c47a6a5aa6059caedda50"
format_stamp: "Formatted at 2026-08-11 11:49:45 on dist-test-slave-vkjp"
server_key: "f7f0a3a2c5d10811fbbb8592f8a52501"
server_key_iv: "0a90660b1c359515bb6d0b2c6f7fe774"
server_key_version: "encryptionkey@0"
I20260811 11:49:45.250926 15475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "fda59265a04c47a6a5aa6059caedda50"
format_stamp: "Formatted at 2026-08-11 11:49:45 on dist-test-slave-vkjp"
server_key: "f7f0a3a2c5d10811fbbb8592f8a52501"
server_key_iv: "0a90660b1c359515bb6d0b2c6f7fe774"
server_key_version: "encryptionkey@0"
I20260811 11:49:45.254602 15475 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 11:49:45.257179 15494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:45.258561 15475 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 11:49:45.258672 15475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "fda59265a04c47a6a5aa6059caedda50"
format_stamp: "Formatted at 2026-08-11 11:49:45 on dist-test-slave-vkjp"
server_key: "f7f0a3a2c5d10811fbbb8592f8a52501"
server_key_iv: "0a90660b1c359515bb6d0b2c6f7fe774"
server_key_version: "encryptionkey@0"
I20260811 11:49:45.258767 15475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:45.294526 15475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:45.297906 15475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:45.298113 15475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:45.306445 15475 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:33721
I20260811 11:49:45.306476 15554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:33721 every 8 connection(s)
I20260811 11:49:45.307542 15475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:45.310405 15555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:45.311487 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 15475
I20260811 11:49:45.311673 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:45.312000 21457 external_mini_cluster.cc:1428] Setting key ddda8988effb223bd191afb8d28f0f2b
I20260811 11:49:45.317620 15555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50: Bootstrap starting.
I20260811 11:49:45.320358 15555 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:45.321224 15555 log.cc:824] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50: Log is configured to *not* fsync() on all Append() calls
Aug 11 11:49:45 dist-test-slave-vkjp krb5kdc[15460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448985, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:49:45.323632 15555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50: No bootstrap required, opened a new log
I20260811 11:49:45.328562 15560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:45.313593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45381 (local address 127.20.244.126:33721)
0811 11:49:45.314050 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:45.314075 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:45.314123 (+ 48us) server_negotiation.cc:407] Connection header received
0811 11:49:45.315013 (+ 890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:45.315037 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:45.315508 (+ 471us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:45.315900 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:45.316722 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:45.318184 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:45.319121 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:45.319822 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:45.319995 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:45.322723 (+ 2728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:45.322731 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:45.322747 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:45.322781 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:45.325053 (+ 2272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:45.325524 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:45.325532 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:45.325540 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:45.325689 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:45.326003 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:45.326017 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:45.326021 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:45.326634 (+ 613us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:45.326832 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:45.327147 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 11:49:45.327471 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":124,"threads_started":1}
I20260811 11:49:45.328619 15555 raft_consensus.cc:348] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fda59265a04c47a6a5aa6059caedda50" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33721 } }
I20260811 11:49:45.328912 15555 raft_consensus.cc:374] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:45.328979 15555 raft_consensus.cc:729] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fda59265a04c47a6a5aa6059caedda50, State: Initialized, Role: FOLLOWER
I20260811 11:49:45.329442 15555 consensus_queue.cc:260] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fda59265a04c47a6a5aa6059caedda50" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33721 } }
I20260811 11:49:45.329613 15555 raft_consensus.cc:388] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:45.329684 15555 raft_consensus.cc:482] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:45.329800 15555 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:45.330946 15555 raft_consensus.cc:504] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fda59265a04c47a6a5aa6059caedda50" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33721 } }
I20260811 11:49:45.331354 15555 leader_election.cc:302] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fda59265a04c47a6a5aa6059caedda50; no voters:
I20260811 11:49:45.331806 15555 leader_election.cc:288] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:45.331835 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:49:45.331919 15562 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:45.332152 15562 raft_consensus.cc:686] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50 [term 1 LEADER]: Becoming Leader. State: Replica: fda59265a04c47a6a5aa6059caedda50, State: Running, Role: LEADER
I20260811 11:49:45.332484 15562 consensus_queue.cc:237] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fda59265a04c47a6a5aa6059caedda50" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33721 } }
I20260811 11:49:45.333220 15555 sys_catalog.cc:564] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:45.333606 15562 sys_catalog.cc:455] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fda59265a04c47a6a5aa6059caedda50. Latest consensus state: current_term: 1 leader_uuid: "fda59265a04c47a6a5aa6059caedda50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fda59265a04c47a6a5aa6059caedda50" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33721 } } }
I20260811 11:49:45.333724 15562 sys_catalog.cc:458] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:45.334064 15563 sys_catalog.cc:455] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fda59265a04c47a6a5aa6059caedda50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fda59265a04c47a6a5aa6059caedda50" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 33721 } } }
I20260811 11:49:45.334151 15563 sys_catalog.cc:458] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50 [sys.catalog]: This master's current role is: LEADER
W20260811 11:49:45.338974 15584 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:49:45.339125 15584 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:49:45.339213 15570 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:45.340387 15570 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:45.345077 15560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:45.334260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34697 (local address 127.20.244.126:33721)
0811 11:49:45.334390 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:45.334394 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:45.334745 (+ 351us) server_negotiation.cc:407] Connection header received
0811 11:49:45.334874 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:45.334880 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:45.334939 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:45.335047 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:45.336405 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:45.337088 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:45.338362 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:45.338708 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:45.338842 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:45.340840 (+ 1998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:45.340845 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:45.340849 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:45.340877 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:45.342835 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:45.343438 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:45.343445 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:45.343448 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:45.343564 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:45.343984 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:45.343991 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:45.343993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:45.344238 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:45.344359 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:45.344771 (+ 412us) server_negotiation.cc:299] Negotiation successful
0811 11:49:45.344904 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 11:49:45.347153 15570 catalog_manager.cc:1347] Generated new cluster ID: 224b9a15dd244a00891a78017dfcaf0a
I20260811 11:49:45.347224 15570 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:45.359368 15570 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:45.360632 15570 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:45.367496 15570 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fda59265a04c47a6a5aa6059caedda50: Generated new TSK 0
I20260811 11:49:45.368220 15570 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:49:45.377571 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 15475
2026-08-11T11:49:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1567 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:45 dist-test-slave-vkjp krb5kdc[15590](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:45 dist-test-slave-vkjp krb5kdc[15590](info): set up 2 sockets
Aug 11 11:49:45 dist-test-slave-vkjp krb5kdc[15590](info): commencing operation
krb5kdc: starting...
W20260811 11:49:46.574672 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:46 dist-test-slave-vkjp krb5kdc[15590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448986, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:49:46.712280 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:34429
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:34051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:34429
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:46.830399 15606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:46.830672 15606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:46.830713 15606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:46.834915 15606 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:46.835000 15606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:46.835019 15606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:46.835035 15606 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:46.835052 15606 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:46.840701 15606 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:34051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:34429
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:34429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15606
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:46.841807 15606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:46.842800 15606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:46.851648 15616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:46.851855 15606 server_base.cc:1034] running on GCE node
W20260811 11:49:46.851657 15611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:46.851648 15613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:46.852646 15606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:46.853871 15606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:46.855146 15606 hybrid_clock.cc:648] HybridClock initialized: now 1786448986855108 us; error 42 us; skew 500 ppm
Aug 11 11:49:46 dist-test-slave-vkjp krb5kdc[15590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448986, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:46.858191 15606 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:49:46.859413 15606 webserver.cc:460] Webserver started at http://127.20.244.126:44965/ using document root <none> and password file <none>
I20260811 11:49:46.860041 15606 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:46.860141 15606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:46.860419 15606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:46.862766 15606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "ec442fec46e54318842151401bd7942b"
format_stamp: "Formatted at 2026-08-11 11:49:46 on dist-test-slave-vkjp"
server_key: "bfa09437a9c90ec2b1aa9722481531b2"
server_key_iv: "49466007b0ab13c506b4a50a6fa5898f"
server_key_version: "encryptionkey@0"
I20260811 11:49:46.863521 15606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "ec442fec46e54318842151401bd7942b"
format_stamp: "Formatted at 2026-08-11 11:49:46 on dist-test-slave-vkjp"
server_key: "bfa09437a9c90ec2b1aa9722481531b2"
server_key_iv: "49466007b0ab13c506b4a50a6fa5898f"
server_key_version: "encryptionkey@0"
I20260811 11:49:46.868264 15606 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 11:49:46.871061 15625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:46.872535 15606 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 11:49:46.872704 15606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "ec442fec46e54318842151401bd7942b"
format_stamp: "Formatted at 2026-08-11 11:49:46 on dist-test-slave-vkjp"
server_key: "bfa09437a9c90ec2b1aa9722481531b2"
server_key_iv: "49466007b0ab13c506b4a50a6fa5898f"
server_key_version: "encryptionkey@0"
I20260811 11:49:46.872840 15606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:46.895046 15606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:46.898547 15606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:46.898772 15606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:46.906385 15606 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:34429
I20260811 11:49:46.906405 15690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:34429 every 8 connection(s)
I20260811 11:49:46.907462 15606 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:46.910254 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 15606
I20260811 11:49:46.910284 15692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:46.910418 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:46.910722 21457 external_mini_cluster.cc:1428] Setting key 958abe1d83e324e89b80bd08623f1b98
I20260811 11:49:46.917168 15692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b: Bootstrap starting.
I20260811 11:49:46.919585 15692 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:46.920467 15692 log.cc:824] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:46.920979 15695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:46.912286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36973 (local address 127.20.244.126:34429)
0811 11:49:46.912801 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:46.912817 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:46.912861 (+ 44us) server_negotiation.cc:407] Connection header received
0811 11:49:46.913736 (+ 875us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:46.913758 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:46.914138 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:46.914606 (+ 468us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:46.915055 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:46.916219 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:46.917253 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:46.917840 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:46.918040 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:46.918976 (+ 936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:46.918981 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:46.918995 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:46.919511 (+ 516us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:46.919575 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:46.919602 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:46.919724 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:46.919854 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 11:49:46.920095 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":153,"threads_started":1}
I20260811 11:49:46.922732 15692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b: No bootstrap required, opened a new log
I20260811 11:49:46.924163 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:49:46.926916 15692 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec442fec46e54318842151401bd7942b" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34429 } }
I20260811 11:49:46.927237 15692 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:46.927369 15692 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec442fec46e54318842151401bd7942b, State: Initialized, Role: FOLLOWER
I20260811 11:49:46.927881 15692 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec442fec46e54318842151401bd7942b" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34429 } }
I20260811 11:49:46.928040 15692 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:46.928098 15692 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:46.928200 15692 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:46.929280 15692 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec442fec46e54318842151401bd7942b" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34429 } }
I20260811 11:49:46.929668 15692 leader_election.cc:302] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec442fec46e54318842151401bd7942b; no voters:
I20260811 11:49:46.930086 15692 leader_election.cc:288] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:46.930213 15702 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:46.930474 15702 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b [term 1 LEADER]: Becoming Leader. State: Replica: ec442fec46e54318842151401bd7942b, State: Running, Role: LEADER
I20260811 11:49:46.930896 15702 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec442fec46e54318842151401bd7942b" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34429 } }
I20260811 11:49:46.931207 15695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:46.926392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60043 (local address 127.20.244.126:34429)
0811 11:49:46.926546 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:46.926551 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:46.926683 (+ 132us) server_negotiation.cc:407] Connection header received
0811 11:49:46.926859 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:46.926862 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:46.926916 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:46.927010 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:46.927359 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:46.928127 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:46.929078 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:46.929460 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:46.929571 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:46.930537 (+ 966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:46.930544 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:46.930547 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:46.930563 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:46.930597 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:46.930611 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:46.930680 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:46.930852 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 11:49:46.930910 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 11:49:46.931730 15692 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:46.933218 15705 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec442fec46e54318842151401bd7942b. Latest consensus state: current_term: 1 leader_uuid: "ec442fec46e54318842151401bd7942b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec442fec46e54318842151401bd7942b" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34429 } } }
I20260811 11:49:46.933377 15705 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:46.933851 15712 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:46.934031 15704 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec442fec46e54318842151401bd7942b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec442fec46e54318842151401bd7942b" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 34429 } } }
I20260811 11:49:46.934134 15704 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:46.937383 15712 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:46.943375 15712 catalog_manager.cc:1347] Generated new cluster ID: ec6fb1ae2990470b9211cf61583c3b65
I20260811 11:49:46.943454 15712 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:46.968859 15712 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:46.969878 15712 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:46.976747 15712 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec442fec46e54318842151401bd7942b: Generated new TSK 0
I20260811 11:49:46.977476 15712 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:49:46.987038 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 15606
2026-08-11T11:49:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1609 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:47 dist-test-slave-vkjp krb5kdc[15725](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:47 dist-test-slave-vkjp krb5kdc[15725](info): set up 2 sockets
Aug 11 11:49:47 dist-test-slave-vkjp krb5kdc[15725](info): commencing operation
krb5kdc: starting...
W20260811 11:49:48.136240 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.007s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:48 dist-test-slave-vkjp krb5kdc[15725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448988, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:49:48.274331 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:43761
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:37687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:43761
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:48.390038 15740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:48.390378 15740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:48.390475 15740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:48.394584 15740 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:48.394682 15740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:48.394723 15740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:48.394785 15740 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:48.394820 15740 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:48.400287 15740 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:37687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:43761
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:43761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15740
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:48.401443 15740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:48.402519 15740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:48.411962 15746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:48.411963 15747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:48.412024 15740 server_base.cc:1034] running on GCE node
W20260811 11:49:48.411962 15749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:48.412943 15740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:48.414069 15740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:48.415232 15740 hybrid_clock.cc:648] HybridClock initialized: now 1786448988415214 us; error 33 us; skew 500 ppm
Aug 11 11:49:48 dist-test-slave-vkjp krb5kdc[15725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448988, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:48.418284 15740 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:49:48.419363 15740 webserver.cc:460] Webserver started at http://127.20.244.126:42207/ using document root <none> and password file <none>
I20260811 11:49:48.419955 15740 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:48.420047 15740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:48.420295 15740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:48.422441 15740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "4ead0bcd5bbc4798b0fa770ef5e95f04"
format_stamp: "Formatted at 2026-08-11 11:49:48 on dist-test-slave-vkjp"
server_key: "604829aefba45c59ed798415aa2e636f"
server_key_iv: "d335460ac194d995204de00d7e9047d2"
server_key_version: "encryptionkey@0"
I20260811 11:49:48.423064 15740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "4ead0bcd5bbc4798b0fa770ef5e95f04"
format_stamp: "Formatted at 2026-08-11 11:49:48 on dist-test-slave-vkjp"
server_key: "604829aefba45c59ed798415aa2e636f"
server_key_iv: "d335460ac194d995204de00d7e9047d2"
server_key_version: "encryptionkey@0"
I20260811 11:49:48.427227 15740 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 11:49:48.430008 15756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:48.431476 15740 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:49:48.431627 15740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "4ead0bcd5bbc4798b0fa770ef5e95f04"
format_stamp: "Formatted at 2026-08-11 11:49:48 on dist-test-slave-vkjp"
server_key: "604829aefba45c59ed798415aa2e636f"
server_key_iv: "d335460ac194d995204de00d7e9047d2"
server_key_version: "encryptionkey@0"
I20260811 11:49:48.431759 15740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:48.436865 15740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:48.440594 15740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:48.440848 15740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:48.448948 15740 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:43761
I20260811 11:49:48.448995 15816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:43761 every 8 connection(s)
I20260811 11:49:48.449962 15740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:48.452243 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 15740
I20260811 11:49:48.452415 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:48.452715 21457 external_mini_cluster.cc:1428] Setting key 4a620384d18e7673c753ae3f80044945
I20260811 11:49:48.453052 15817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:48.458473 15820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:48.454199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52143 (local address 127.20.244.126:43761)
0811 11:49:48.454651 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:48.454671 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:48.454714 (+ 43us) server_negotiation.cc:407] Connection header received
0811 11:49:48.455515 (+ 801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:48.455540 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:48.455900 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:48.456264 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:48.457023 (+ 759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:48.457029 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:48.457044 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:48.457057 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:48.457125 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:48.457153 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:48.457308 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:48.457377 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 11:49:48.457540 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":137,"threads_started":1}
I20260811 11:49:48.460620 15817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04: Bootstrap starting.
I20260811 11:49:48.461437 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:49:48.463073 15817 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:48.464030 15817 log.cc:824] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:48.465587 15820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:48.463599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37875 (local address 127.20.244.126:43761)
0811 11:49:48.463726 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:48.463731 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:48.464002 (+ 271us) server_negotiation.cc:407] Connection header received
0811 11:49:48.464108 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:48.464112 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:48.464153 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:48.464236 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:48.465193 (+ 957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:48.465196 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:48.465198 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:49:48.465209 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:48.465234 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:49:48.465244 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:48.465318 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:48.465419 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 11:49:48.465465 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 11:49:48.466645 15817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04: No bootstrap required, opened a new log
I20260811 11:49:48.470229 15817 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ead0bcd5bbc4798b0fa770ef5e95f04" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 43761 } }
I20260811 11:49:48.470494 15817 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:49:48.470554 15817 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ead0bcd5bbc4798b0fa770ef5e95f04, State: Initialized, Role: FOLLOWER
I20260811 11:49:48.470981 15817 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ead0bcd5bbc4798b0fa770ef5e95f04" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 43761 } }
I20260811 11:49:48.471165 15817 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:49:48.471257 15817 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:49:48.471359 15817 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:48.472558 15817 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ead0bcd5bbc4798b0fa770ef5e95f04" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 43761 } }
I20260811 11:49:48.472903 15817 leader_election.cc:302] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ead0bcd5bbc4798b0fa770ef5e95f04; no voters:
I20260811 11:49:48.473258 15817 leader_election.cc:288] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:49:48.473383 15827 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:48.473649 15827 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04 [term 1 LEADER]: Becoming Leader. State: Replica: 4ead0bcd5bbc4798b0fa770ef5e95f04, State: Running, Role: LEADER
I20260811 11:49:48.474010 15827 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ead0bcd5bbc4798b0fa770ef5e95f04" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 43761 } }
I20260811 11:49:48.474540 15817 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:48.475797 15829 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ead0bcd5bbc4798b0fa770ef5e95f04. Latest consensus state: current_term: 1 leader_uuid: "4ead0bcd5bbc4798b0fa770ef5e95f04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ead0bcd5bbc4798b0fa770ef5e95f04" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 43761 } } }
I20260811 11:49:48.475927 15829 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:48.476336 15839 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:48.476715 15828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ead0bcd5bbc4798b0fa770ef5e95f04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ead0bcd5bbc4798b0fa770ef5e95f04" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 43761 } } }
I20260811 11:49:48.476871 15828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:48.479041 15839 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:48.484942 15839 catalog_manager.cc:1347] Generated new cluster ID: 20b95408e21740dfb7a55ff8382d0d4f
I20260811 11:49:48.485049 15839 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:48.528497 15839 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:48.528903 15839 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:48.541745 15839 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ead0bcd5bbc4798b0fa770ef5e95f04: Generated new TSK 0
I20260811 11:49:48.542622 15839 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:49:48.547021 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 15740
2026-08-11T11:49:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1561 ms)
[----------] 18 tests from AuthTokenIssuingTest (28336 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:48 dist-test-slave-vkjp krb5kdc[15854](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:48 dist-test-slave-vkjp krb5kdc[15854](info): set up 2 sockets
Aug 11 11:49:48 dist-test-slave-vkjp krb5kdc[15854](info): commencing operation
krb5kdc: starting...
W20260811 11:49:49.714833 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:49 dist-test-slave-vkjp krb5kdc[15854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:49:49.854477 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:45701
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:39847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:45701,127.20.244.125:42263,127.20.244.124:44091
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:49.971943 15869 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 11:49:49.972250 15869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:49.972275 15869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:49.972357 15869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:49.976642 15869 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:49.976712 15869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:49.976732 15869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:49.976749 15869 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:49.976794 15869 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:49.982465 15869 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:39847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:45701,127.20.244.125:42263,127.20.244.124:44091
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:45701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15869
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:49.983732 15869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:49.984831 15869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:49.994946 15878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:49.994939 15875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:49.995177 15869 server_base.cc:1034] running on GCE node
W20260811 11:49:49.994939 15876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:49.995999 15869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:49.997243 15869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:49.998414 15869 hybrid_clock.cc:648] HybridClock initialized: now 1786448989998397 us; error 27 us; skew 500 ppm
Aug 11 11:49:49 dist-test-slave-vkjp krb5kdc[15854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448989, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:50.007370 15869 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:49:50.008569 15869 webserver.cc:460] Webserver started at http://127.20.244.126:45819/ using document root <none> and password file <none>
I20260811 11:49:50.009222 15869 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:50.009331 15869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:50.009584 15869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:50.011895 15869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "9f8764c9deb445049756ef9f8e0c2de9"
format_stamp: "Formatted at 2026-08-11 11:49:50 on dist-test-slave-vkjp"
server_key: "1fdc015dbe7ac802657a7b1bba32bc8f"
server_key_iv: "149bf0fc7d88f49de8ae55d3efc70c78"
server_key_version: "encryptionkey@0"
I20260811 11:49:50.012521 15869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "9f8764c9deb445049756ef9f8e0c2de9"
format_stamp: "Formatted at 2026-08-11 11:49:50 on dist-test-slave-vkjp"
server_key: "1fdc015dbe7ac802657a7b1bba32bc8f"
server_key_iv: "149bf0fc7d88f49de8ae55d3efc70c78"
server_key_version: "encryptionkey@0"
I20260811 11:49:50.016697 15869 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 11:49:50.019538 15886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:50.020877 15869 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 11:49:50.021056 15869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "9f8764c9deb445049756ef9f8e0c2de9"
format_stamp: "Formatted at 2026-08-11 11:49:50 on dist-test-slave-vkjp"
server_key: "1fdc015dbe7ac802657a7b1bba32bc8f"
server_key_iv: "149bf0fc7d88f49de8ae55d3efc70c78"
server_key_version: "encryptionkey@0"
I20260811 11:49:50.021189 15869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:50.035701 15869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:50.039626 15869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:50.039860 15869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:50.047385 15869 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:45701
I20260811 11:49:50.047714 15951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:45701 every 8 connection(s)
I20260811 11:49:50.048442 15869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:50.051335 15952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:50.052708 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 15869
I20260811 11:49:50.052860 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:50.053164 21457 external_mini_cluster.cc:1428] Setting key 35f62b779450e2284f505131901896a5
I20260811 11:49:50.056519 15952 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45701 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.20.244.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.125@KRBTEST.COM" created.
Aug 11 11:49:50 dist-test-slave-vkjp krb5kdc[15854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448989, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:49:50.075754 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.059000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:45701 (local address 127.0.0.1:48326)
0811 11:49:50.059621 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.059677 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:50.060683 (+ 1006us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:50.061638 (+ 955us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:50.061643 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:50.062023 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:50.062285 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:50.062299 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.064257 (+ 1958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.064263 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:50.065549 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:50.065561 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.066721 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.066725 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:50.066844 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.067585 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:50.067613 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:50.069635 (+ 2022us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:50.072287 (+ 2652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:50.072296 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:50.072306 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:50.072633 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:50.073097 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:50.073099 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:50.073101 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:50.073220 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:50.074122 (+ 902us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:50.074128 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:50.074266 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 11:49:50.074431 (+ 165us) client_negotiation.cc:240] Negotiation successful
0811 11:49:50.074702 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":162,"threads_started":1}
I20260811 11:49:50.075760 15957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.060050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48326 (local address 127.20.244.126:45701)
0811 11:49:50.060450 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.060474 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.060535 (+ 61us) server_negotiation.cc:407] Connection header received
0811 11:49:50.061067 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.061074 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.061368 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.061633 (+ 265us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.062472 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.064089 (+ 1617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.065732 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.066504 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.066711 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.069852 (+ 3141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:50.069864 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:50.069882 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:50.069917 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:50.072109 (+ 2192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.072809 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.072820 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.072823 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.072990 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.073326 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.073333 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.073338 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.073977 (+ 639us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:50.074147 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:50.074581 (+ 434us) server_negotiation.cc:299] Negotiation successful
0811 11:49:50.074778 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":104,"threads_started":1}
I20260811 11:49:50.078469 15952 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:49:50.079494 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.079175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:42263 (local address 127.0.0.1:50348)
0811 11:49:50.079316 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.079426 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.125:42263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 11:49:50.079808 15889 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.244.125:42263: connect: Connection refused (error 111)
I20260811 11:49:50.080812 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.080577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:42263 (local address 127.0.0.1:50360)
0811 11:49:50.080705 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.080755 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.125:42263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 11:49:50.081054 15952 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.125:42263: Network error: Client connection negotiation failed: client connection to 127.20.244.125:42263: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.125.keytab.
Entry for principal kudu/127.20.244.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.125.keytab.
I20260811 11:49:50.088083 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.125:42263
--webserver_interface=127.20.244.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.125.keytab
--principal=kudu/127.20.244.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:39847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:45701,127.20.244.125:42263,127.20.244.124:44091
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:49:50.130344 15952 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } attempt: 1
I20260811 11:49:50.131429 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.131021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:42263 (local address 127.0.0.1:50362)
0811 11:49:50.131251 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.131319 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.125:42263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122}
I20260811 11:49:50.132231 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.132005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:42263 (local address 127.0.0.1:50372)
0811 11:49:50.132119 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.132175 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.125:42263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 11:49:50.132372 15952 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.125:42263: Network error: Client connection negotiation failed: client connection to 127.20.244.125:42263: connect: Connection refused (error 111)
I20260811 11:49:50.200567 15952 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } attempt: 2
I20260811 11:49:50.201659 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.201256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:42263 (local address 127.0.0.1:50374)
0811 11:49:50.201506 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.201575 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.125:42263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
I20260811 11:49:50.202494 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.202229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:42263 (local address 127.0.0.1:50386)
0811 11:49:50.202367 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.202430 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.125:42263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 11:49:50.202623 15952 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.125:42263: Network error: Client connection negotiation failed: client connection to 127.20.244.125:42263: connect: Connection refused (error 111)
W20260811 11:49:50.208770 15961 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 11:49:50.209074 15961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:50.209151 15961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:50.209242 15961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:50.213904 15961 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:50.213974 15961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:50.214002 15961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:50.214021 15961 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:50.214082 15961 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:50.220085 15961 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:39847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:45701,127.20.244.125:42263,127.20.244.124:44091
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.125.keytab
--principal=kudu/127.20.244.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.125:42263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.244.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15961
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:50.221257 15961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:50.222325 15961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:49:50.231458 15961 server_base.cc:1034] running on GCE node
W20260811 11:49:50.231406 15966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:50.231406 15969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:50.231423 15967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:50.232276 15961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:50.233388 15961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:50.234591 15961 hybrid_clock.cc:648] HybridClock initialized: now 1786448990234575 us; error 27 us; skew 500 ppm
Aug 11 11:49:50 dist-test-slave-vkjp krb5kdc[15854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448990, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:50.237592 15961 init.cc:377] Logged in from keytab as kudu/127.20.244.125@KRBTEST.COM (short username kudu)
I20260811 11:49:50.238637 15961 webserver.cc:460] Webserver started at http://127.20.244.125:33337/ using document root <none> and password file <none>
I20260811 11:49:50.239434 15961 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:50.239548 15961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:50.239821 15961 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:50.242183 15961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-1/data/instance:
uuid: "2426885362f7480187b6002211efe9cf"
format_stamp: "Formatted at 2026-08-11 11:49:50 on dist-test-slave-vkjp"
server_key: "cea455acd8623f743952a4421b2bf34e"
server_key_iv: "c08a80cc5e5bc45696cf85de72264d7f"
server_key_version: "encryptionkey@0"
I20260811 11:49:50.242892 15961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-1/wal/instance:
uuid: "2426885362f7480187b6002211efe9cf"
format_stamp: "Formatted at 2026-08-11 11:49:50 on dist-test-slave-vkjp"
server_key: "cea455acd8623f743952a4421b2bf34e"
server_key_iv: "c08a80cc5e5bc45696cf85de72264d7f"
server_key_version: "encryptionkey@0"
I20260811 11:49:50.247313 15961 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 11:49:50.250204 15977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:50.251788 15961 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:49:50.251960 15961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-1/wal
uuid: "2426885362f7480187b6002211efe9cf"
format_stamp: "Formatted at 2026-08-11 11:49:50 on dist-test-slave-vkjp"
server_key: "cea455acd8623f743952a4421b2bf34e"
server_key_iv: "c08a80cc5e5bc45696cf85de72264d7f"
server_key_version: "encryptionkey@0"
I20260811 11:49:50.252100 15961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:50.270290 15961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:50.274080 15961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:50.274338 15961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:50.282286 15961 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.125:42263
I20260811 11:49:50.282598 16042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.125:42263 every 8 connection(s)
I20260811 11:49:50.283560 15961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-1/data/info.pb
I20260811 11:49:50.286211 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 15961
I20260811 11:49:50.286324 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-1/wal/instance
I20260811 11:49:50.286649 21457 external_mini_cluster.cc:1428] Setting key e48e7f86f248155e13788e683101d964
I20260811 11:49:50.286651 16043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:50.292337 16043 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45701 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:49:50.293816 15952 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } attempt: 3
WARNING: no policy specified for kudu/127.20.244.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.124@KRBTEST.COM" created.
Aug 11 11:49:50 dist-test-slave-vkjp krb5kdc[15854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448989, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for kudu/127.20.244.125@KRBTEST.COM
Aug 11 11:49:50 dist-test-slave-vkjp krb5kdc[15854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448990, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.125@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:49:50.307915 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.294468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:42263 (local address 127.0.0.1:50400)
0811 11:49:50.294656 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.294677 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:50.294791 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:50.297594 (+ 2803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:50.297597 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:50.297804 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:50.297933 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:50.297941 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.299318 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.299322 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:50.299929 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:50.299939 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.300771 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.300774 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:50.300940 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.301689 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:50.301721 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:50.303364 (+ 1643us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:50.305772 (+ 2408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:50.305777 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:50.305779 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:50.306076 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:50.306473 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:50.306476 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:50.306478 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:50.306580 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:50.307312 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:50.307315 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:50.307432 (+ 117us) client_negotiation.cc:769] Sending connection context
0811 11:49:50.307560 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 11:49:50.307718 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68,"mutex_wait_us":26}
I20260811 11:49:50.309101 16048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.296437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50400 (local address 127.20.244.125:42263)
0811 11:49:50.296798 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.296809 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.296854 (+ 45us) server_negotiation.cc:407] Connection header received
0811 11:49:50.297128 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.297155 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.297413 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.297613 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.298107 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.299197 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.300103 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.300641 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.300820 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.303564 (+ 2744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:50.303572 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:50.303590 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:50.303622 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:50.305641 (+ 2019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.306204 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.306212 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.306219 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.306360 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.306676 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.306681 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.306682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.307197 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:50.307358 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:50.307744 (+ 386us) server_negotiation.cc:299] Negotiation successful
0811 11:49:50.308091 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":234,"thread_start_us":106,"threads_started":1}
I20260811 11:49:50.309547 15957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.295043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48330 (local address 127.20.244.126:45701)
0811 11:49:50.295197 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.295202 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.296214 (+ 1012us) server_negotiation.cc:407] Connection header received
0811 11:49:50.297388 (+ 1174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.297394 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.297464 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.297574 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.298570 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.299170 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.300527 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.301002 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.301137 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.304259 (+ 3122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:50.304265 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:50.304271 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:50.304306 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:50.307200 (+ 2894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.307877 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.307883 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.307887 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.307992 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.308361 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.308366 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.308368 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.308607 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:50.308692 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:50.309224 (+ 532us) server_negotiation.cc:299] Negotiation successful
0811 11:49:50.309402 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":70}
I20260811 11:49:50.309561 16047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.295508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:45701 (local address 127.0.0.1:48330)
0811 11:49:50.296028 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.296082 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:50.297128 (+ 1046us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:50.297642 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:50.297648 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:50.298115 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:50.298418 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:50.298430 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.299338 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.299344 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:50.300344 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:50.300397 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.301187 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.301195 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:50.301355 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.301893 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:50.301919 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:50.304040 (+ 2121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:50.307346 (+ 3306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:50.307358 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:50.307367 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:50.307720 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:50.308126 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:50.308132 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:50.308136 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:50.308239 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:50.308799 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:50.308806 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:50.308940 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 11:49:50.309110 (+ 170us) client_negotiation.cc:240] Negotiation successful
0811 11:49:50.309330 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"mutex_wait_us":32,"thread_start_us":154,"threads_started":1}
I20260811 11:49:50.311476 16043 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:49:50.311729 15952 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:49:50.312548 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.312262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44091 (local address 127.0.0.1:36024)
0811 11:49:50.312393 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.312462 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 11:49:50.313437 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.313127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44091 (local address 127.0.0.1:36030)
0811 11:49:50.313267 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.313350 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260811 11:49:50.313589 15952 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.124:44091: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44091: connect: Connection refused (error 111)
Aug 11 11:49:50 dist-test-slave-vkjp krb5kdc[15854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448990, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.125@KRBTEST.COM for kudu/127.20.244.125@KRBTEST.COM
I20260811 11:49:50.321360 16047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.312083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:42263 (local address 127.0.0.1:50410)
0811 11:49:50.312263 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.312276 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:50.312383 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:50.312627 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:50.312633 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:50.312859 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:50.313015 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:50.313027 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.314009 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.314012 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:50.314623 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:50.314632 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.315207 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.315211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:50.315320 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.315774 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:50.315786 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:50.317415 (+ 1629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:50.319536 (+ 2121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:50.319539 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:50.319540 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:50.319763 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:50.320090 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:50.320094 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:50.320095 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:50.320185 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:50.320810 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:50.320813 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:50.320904 (+ 91us) client_negotiation.cc:769] Sending connection context
0811 11:49:50.321021 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 11:49:50.321159 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105}
I20260811 11:49:50.321484 16048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.312323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50410 (local address 127.20.244.125:42263)
0811 11:49:50.312434 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.312437 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.312449 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:49:50.312479 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.312481 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.312515 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.312578 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.313148 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.313894 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.314740 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.314999 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.315178 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.317615 (+ 2437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:50.317618 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:50.317620 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:50.317643 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:50.319422 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.319897 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.319901 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.319903 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.319980 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.320382 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.320389 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.320396 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.320682 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:50.320774 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:50.321139 (+ 365us) server_negotiation.cc:299] Negotiation successful
0811 11:49:50.321342 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.124.keytab.
Entry for principal kudu/127.20.244.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.124.keytab.
I20260811 11:49:50.322494 16043 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:49:50.322969 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.124:44091
--webserver_interface=127.20.244.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.124.keytab
--principal=kudu/127.20.244.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:39847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:45701,127.20.244.125:42263,127.20.244.124:44091
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:49:50.323455 16047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.323091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44091 (local address 127.0.0.1:36032)
0811 11:49:50.323302 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.323386 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
W20260811 11:49:50.324152 15981 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44091: connect: Connection refused (error 111)
I20260811 11:49:50.325199 16047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.324942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44091 (local address 127.0.0.1:36046)
0811 11:49:50.325071 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.325136 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 11:49:50.325469 16043 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.124:44091: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44091: connect: Connection refused (error 111)
I20260811 11:49:50.344774 15952 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } attempt: 1
I20260811 11:49:50.345794 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.345421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44091 (local address 127.0.0.1:36054)
0811 11:49:50.345618 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.345690 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260811 11:49:50.346685 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.346426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44091 (local address 127.0.0.1:36056)
0811 11:49:50.346557 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.346615 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 11:49:50.346838 15952 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.124:44091: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44091: connect: Connection refused (error 111)
I20260811 11:49:50.374758 16043 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } attempt: 1
I20260811 11:49:50.375860 16047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.375478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44091 (local address 127.0.0.1:48078)
0811 11:49:50.375672 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.375755 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260811 11:49:50.376830 16047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.376571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44091 (local address 127.0.0.1:48094)
0811 11:49:50.376694 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.376756 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 11:49:50.377022 16043 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.124:44091: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44091: connect: Connection refused (error 111)
I20260811 11:49:50.422049 15952 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } attempt: 2
I20260811 11:49:50.423017 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.422672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44091 (local address 127.0.0.1:48104)
0811 11:49:50.422849 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.422927 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 11:49:50.423918 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.423675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44091 (local address 127.0.0.1:48118)
0811 11:49:50.423787 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.423853 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 11:49:50.424084 15952 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.124:44091: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44091: connect: Connection refused (error 111)
I20260811 11:49:50.445209 16043 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } attempt: 2
W20260811 11:49:50.445437 16051 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 11:49:50.445848 16051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:50.445911 16051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:50.445997 16051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 11:49:50.446270 16047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.445911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44091 (local address 127.0.0.1:48132)
0811 11:49:50.446105 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.446177 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 11:49:50.447320 16047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.447044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44091 (local address 127.0.0.1:48146)
0811 11:49:50.447190 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.447244 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260811 11:49:50.447481 16043 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.124:44091: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44091: connect: Connection refused (error 111)
W20260811 11:49:50.450709 16051 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:50.450805 16051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:50.450850 16051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:50.450907 16051 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:50.450944 16051 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:50.456728 16051 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:39847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:45701,127.20.244.125:42263,127.20.244.124:44091
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.124.keytab
--principal=kudu/127.20.244.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.124:44091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.244.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16051
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:50.457967 16051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:50.459043 16051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:50.468256 16057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:50.468250 16056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:50.468250 16059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:50.468861 16051 server_base.cc:1034] running on GCE node
I20260811 11:49:50.469542 16051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:50.470808 16051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:50.472004 16051 hybrid_clock.cc:648] HybridClock initialized: now 1786448990471967 us; error 56 us; skew 500 ppm
Aug 11 11:49:50 dist-test-slave-vkjp krb5kdc[15854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448990, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:50.475055 16051 init.cc:377] Logged in from keytab as kudu/127.20.244.124@KRBTEST.COM (short username kudu)
I20260811 11:49:50.476226 16051 webserver.cc:460] Webserver started at http://127.20.244.124:39575/ using document root <none> and password file <none>
I20260811 11:49:50.476881 16051 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:50.476977 16051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:50.477254 16051 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:50.479548 16051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-2/data/instance:
uuid: "d6f6820a3ec54f40bcce84cb128ee421"
format_stamp: "Formatted at 2026-08-11 11:49:50 on dist-test-slave-vkjp"
server_key: "c4b7361dd5c09b669892c1c3e7c5dbfb"
server_key_iv: "fa2180e98e5c3a9716f49c66118a7a26"
server_key_version: "encryptionkey@0"
I20260811 11:49:50.480172 16051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-2/wal/instance:
uuid: "d6f6820a3ec54f40bcce84cb128ee421"
format_stamp: "Formatted at 2026-08-11 11:49:50 on dist-test-slave-vkjp"
server_key: "c4b7361dd5c09b669892c1c3e7c5dbfb"
server_key_iv: "fa2180e98e5c3a9716f49c66118a7a26"
server_key_version: "encryptionkey@0"
I20260811 11:49:50.484205 16051 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 11:49:50.486804 16068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:50.488098 16051 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 11:49:50.488250 16051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-2/wal
uuid: "d6f6820a3ec54f40bcce84cb128ee421"
format_stamp: "Formatted at 2026-08-11 11:49:50 on dist-test-slave-vkjp"
server_key: "c4b7361dd5c09b669892c1c3e7c5dbfb"
server_key_iv: "fa2180e98e5c3a9716f49c66118a7a26"
server_key_version: "encryptionkey@0"
I20260811 11:49:50.488374 16051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:50.514976 16051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:50.518887 16051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:50.519181 16051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:50.523242 15952 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } attempt: 3
I20260811 11:49:50.524289 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.523861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44091 (local address 127.0.0.1:48154)
0811 11:49:50.524064 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.524148 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 11:49:50.525386 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.525030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44091 (local address 127.0.0.1:48164)
0811 11:49:50.525180 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.525261 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 11:49:50.525571 15952 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.124:44091: Network error: Client connection negotiation failed: client connection to 127.20.244.124:44091: connect: Connection refused (error 111)
I20260811 11:49:50.527592 16051 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.124:44091
I20260811 11:49:50.527925 16131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.124:44091 every 8 connection(s)
I20260811 11:49:50.528710 16051 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-2/data/info.pb
I20260811 11:49:50.531881 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 16051
I20260811 11:49:50.531980 16132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:50.532024 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786448696706302-21457-0/minicluster-data/master-2/wal/instance
I20260811 11:49:50.532351 21457 external_mini_cluster.cc:1428] Setting key ee9d1c37ffeab14cb2b8ebe9cdeff1d1
I20260811 11:49:50.537511 16132 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45701 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:49:50.538674 16043 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } attempt: 3
Aug 11 11:49:50 dist-test-slave-vkjp krb5kdc[15854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.124@KRBTEST.COM
Aug 11 11:49:50 dist-test-slave-vkjp krb5kdc[15854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448990, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.125@KRBTEST.COM for kudu/127.20.244.124@KRBTEST.COM
Aug 11 11:49:50 dist-test-slave-vkjp krb5kdc[15854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448990, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.124@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:49:50.550176 16136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.533814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48174 (local address 127.20.244.124:44091)
0811 11:49:50.534268 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.534284 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.534328 (+ 44us) server_negotiation.cc:407] Connection header received
0811 11:49:50.534975 (+ 647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.534993 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.535422 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.535711 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.536706 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.537795 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.539157 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.539945 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.540131 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.543745 (+ 3614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:50.543774 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:50.543789 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:50.543826 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:50.546004 (+ 2178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.546607 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.546614 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.546621 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.546790 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.547143 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.547148 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.547150 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.547775 (+ 625us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:50.547999 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:50.548616 (+ 617us) server_negotiation.cc:299] Negotiation successful
0811 11:49:50.548973 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":155,"threads_started":1}
I20260811 11:49:50.551107 16047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.540751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44091 (local address 127.0.0.1:48180)
0811 11:49:50.540860 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.540877 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:50.540967 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:50.541719 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:50.541724 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:50.541942 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:50.542074 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:50.542081 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.543276 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.543280 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:50.544013 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:50.544025 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.544919 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.544925 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:50.545076 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.545564 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:50.545581 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:50.547138 (+ 1557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:50.549232 (+ 2094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:50.549236 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:50.549238 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:50.549502 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:50.549834 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:50.549837 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:50.549840 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:50.549951 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:50.550505 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:50.550510 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:50.550629 (+ 119us) client_negotiation.cc:769] Sending connection context
0811 11:49:50.550726 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 11:49:50.550885 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 11:49:50.551589 16139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.541055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48180 (local address 127.20.244.124:44091)
0811 11:49:50.541456 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.541466 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.541482 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:49:50.541518 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.541521 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.541563 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.541658 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.542225 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.543158 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.544421 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.544775 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.544890 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.547293 (+ 2403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:50.547296 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:50.547299 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:50.547323 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:50.549105 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.549630 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.549633 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.549634 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.549719 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.550088 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.550090 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.550091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.550370 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:50.551200 (+ 830us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:50.551296 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 11:49:50.551420 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":96,"threads_started":1}
I20260811 11:49:50.553817 15957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.539847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58828 (local address 127.20.244.126:45701)
0811 11:49:50.540039 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.540043 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.542499 (+ 2456us) server_negotiation.cc:407] Connection header received
0811 11:49:50.542714 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.542717 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.542773 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.542865 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.543812 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.544571 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.545880 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.546164 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.546280 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.549674 (+ 3394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:50.549678 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:50.549681 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:50.549719 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:50.551666 (+ 1947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.552227 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.552230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.552232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.552343 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.552700 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.552704 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.552706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.552967 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:50.553078 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:50.553521 (+ 443us) server_negotiation.cc:299] Negotiation successful
0811 11:49:50.553662 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 11:49:50.554347 16138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.539689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:45701 (local address 127.0.0.1:58828)
0811 11:49:50.542271 (+ 2582us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.542367 (+ 96us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:50.542594 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:50.542921 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:50.542928 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:50.543473 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:50.543619 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:50.543626 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.544960 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.544964 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:50.545752 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:50.545762 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.546295 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.546299 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:50.546437 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.547309 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:50.547352 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:50.549508 (+ 2156us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:50.551779 (+ 2271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:50.551794 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:50.551798 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:50.552094 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:50.552469 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:50.552472 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:50.552475 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:50.552568 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:50.553093 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:50.553099 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:50.553226 (+ 127us) client_negotiation.cc:769] Sending connection context
0811 11:49:50.553955 (+ 729us) client_negotiation.cc:240] Negotiation successful
0811 11:49:50.554149 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":977,"spinlock_wait_cycles":2304,"thread_start_us":153,"threads_started":1}
I20260811 11:49:50.555706 16132 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:49:50.555846 16043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2426885362f7480187b6002211efe9cf: Bootstrap starting.
I20260811 11:49:50.559187 16043 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2426885362f7480187b6002211efe9cf: Neither blocks nor log segments found. Creating new log.
Aug 11 11:49:50 dist-test-slave-vkjp krb5kdc[15854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:49:50.560132 16043 log.cc:824] T 00000000000000000000000000000000 P 2426885362f7480187b6002211efe9cf: Log is configured to *not* fsync() on all Append() calls
Aug 11 11:49:50 dist-test-slave-vkjp krb5kdc[15854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448990, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.124@KRBTEST.COM for kudu/127.20.244.125@KRBTEST.COM
I20260811 11:49:50.563176 16043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2426885362f7480187b6002211efe9cf: No bootstrap required, opened a new log
I20260811 11:49:50.564105 16140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.553446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58834 (local address 127.20.244.126:45701)
0811 11:49:50.553768 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.553780 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.553792 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:49:50.553822 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.553824 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.553881 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.554808 (+ 927us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.554936 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.555694 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.556760 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.557058 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.557175 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.559942 (+ 2767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:50.559947 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:50.559949 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:50.559982 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:50.561885 (+ 1903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.562401 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.562405 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.562407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.562502 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.563022 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.563026 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.563027 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.563362 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:50.563598 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:50.563754 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 11:49:50.563880 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":106,"threads_started":1}
I20260811 11:49:50.566068 16138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.556244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:42263 (local address 127.0.0.1:49854)
0811 11:49:50.556406 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.556419 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:50.556504 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:50.557302 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:50.557305 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:50.557539 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:50.557674 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:50.557686 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.558635 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.558641 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:50.559576 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:50.559593 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.560224 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.560229 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:50.560340 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.560750 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:50.560770 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:50.562191 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:50.564114 (+ 1923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:50.564117 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:50.564119 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:50.564361 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:50.564920 (+ 559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:50.564924 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:50.564925 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:50.565016 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:50.565550 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:50.565553 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:50.565652 (+ 99us) client_negotiation.cc:769] Sending connection context
0811 11:49:50.565764 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 11:49:50.565899 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95}
I20260811 11:49:50.566186 16048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.556310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49854 (local address 127.20.244.125:42263)
0811 11:49:50.556440 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.556447 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.556462 (+ 15us) server_negotiation.cc:407] Connection header received
0811 11:49:50.556601 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.556604 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.556653 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.556741 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.557821 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.558495 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.559714 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.560074 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.560200 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.562342 (+ 2142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:50.562346 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:50.562349 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:50.562374 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:50.563982 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.564705 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.564711 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.564712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.564819 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.565127 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.565130 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.565132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.565384 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:50.565500 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:50.565880 (+ 380us) server_negotiation.cc:299] Negotiation successful
0811 11:49:50.565996 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 11:49:50.566915 16132 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:49:50.567607 16043 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2426885362f7480187b6002211efe9cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f8764c9deb445049756ef9f8e0c2de9" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45701 } } peers { permanent_uuid: "2426885362f7480187b6002211efe9cf" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } } peers { permanent_uuid: "d6f6820a3ec54f40bcce84cb128ee421" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } }
I20260811 11:49:50.567868 16043 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2426885362f7480187b6002211efe9cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2426885362f7480187b6002211efe9cf, State: Initialized, Role: FOLLOWER
I20260811 11:49:50.568265 16043 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2426885362f7480187b6002211efe9cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f8764c9deb445049756ef9f8e0c2de9" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45701 } } peers { permanent_uuid: "2426885362f7480187b6002211efe9cf" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } } peers { permanent_uuid: "d6f6820a3ec54f40bcce84cb128ee421" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } }
I20260811 11:49:50.568818 16143 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2426885362f7480187b6002211efe9cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f8764c9deb445049756ef9f8e0c2de9" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45701 } } peers { permanent_uuid: "2426885362f7480187b6002211efe9cf" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } } peers { permanent_uuid: "d6f6820a3ec54f40bcce84cb128ee421" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } } }
I20260811 11:49:50.568974 16143 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2426885362f7480187b6002211efe9cf [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:49:50.569944 16043 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2426885362f7480187b6002211efe9cf [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 11:49:50 dist-test-slave-vkjp krb5kdc[15854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.125@KRBTEST.COM
Aug 11 11:49:50 dist-test-slave-vkjp krb5kdc[15854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448990, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.124@KRBTEST.COM for kudu/127.20.244.124@KRBTEST.COM
W20260811 11:49:50.575891 16154 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2426885362f7480187b6002211efe9cf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:49:50.576031 16154 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:49:50.576720 16138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.567481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44091 (local address 127.0.0.1:48188)
0811 11:49:50.567723 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.567736 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:50.567824 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:50.568138 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:50.568140 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:50.568302 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:50.568384 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:50.568392 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.569371 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.569376 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:50.570078 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:50.570091 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.570545 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.570548 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:50.570622 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.571061 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:50.571119 (+ 58us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:50.572841 (+ 1722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:50.575074 (+ 2233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:50.575100 (+ 26us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:50.575102 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:50.575344 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:50.575613 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:50.575615 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:50.575617 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:50.575691 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:50.576204 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:50.576207 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:50.576304 (+ 97us) client_negotiation.cc:769] Sending connection context
0811 11:49:50.576408 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 11:49:50.576551 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199}
I20260811 11:49:50.577209 16142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.565302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49860 (local address 127.20.244.125:42263)
0811 11:49:50.565624 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.565633 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.565644 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:49:50.565678 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.565686 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.565729 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.566623 (+ 894us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.566777 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.567552 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.568548 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.568887 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.569126 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.572132 (+ 3006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:50.572136 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:50.572139 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:50.572165 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:50.574178 (+ 2013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.574693 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.574696 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.574698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.575376 (+ 678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.575716 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.575719 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.575721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.575940 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:50.576143 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:50.576910 (+ 767us) server_negotiation.cc:299] Negotiation successful
0811 11:49:50.577037 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":132,"threads_started":1}
I20260811 11:49:50.577318 16139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.567552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48188 (local address 127.20.244.124:44091)
0811 11:49:50.567663 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.567667 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.567810 (+ 143us) server_negotiation.cc:407] Connection header received
0811 11:49:50.567930 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.567935 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.567977 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.568023 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.568535 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.569262 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.570186 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.570435 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.570544 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.572978 (+ 2434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:50.572981 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:50.572983 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:50.573005 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:50.574936 (+ 1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.575450 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.575453 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.575454 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.575526 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.575783 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.575786 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.575788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.576065 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:50.576166 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:50.577057 (+ 891us) server_negotiation.cc:299] Negotiation successful
0811 11:49:50.577173 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 11:49:50.574327 15961 master_runner.cc:186] Error getting master registration for 127.20.244.126:45701: OK, instance_id { permanent_uuid: "9f8764c9deb445049756ef9f8e0c2de9" instance_seqno: 1786448990045293 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 11:49:50.578002 15961 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 11:49:50.580793 16132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6f6820a3ec54f40bcce84cb128ee421: Bootstrap starting.
I20260811 11:49:50.581149 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:49:50.583619 16132 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6f6820a3ec54f40bcce84cb128ee421: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:50.582715 15920 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "9f8764c9deb445049756ef9f8e0c2de9"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58834
I20260811 11:49:50.584347 16132 log.cc:824] T 00000000000000000000000000000000 P d6f6820a3ec54f40bcce84cb128ee421: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:50.586273 16132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6f6820a3ec54f40bcce84cb128ee421: No bootstrap required, opened a new log
I20260811 11:49:50.589396 16132 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6f6820a3ec54f40bcce84cb128ee421 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f8764c9deb445049756ef9f8e0c2de9" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45701 } } peers { permanent_uuid: "2426885362f7480187b6002211efe9cf" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } } peers { permanent_uuid: "d6f6820a3ec54f40bcce84cb128ee421" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } }
I20260811 11:49:50.589607 16132 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6f6820a3ec54f40bcce84cb128ee421 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6f6820a3ec54f40bcce84cb128ee421, State: Initialized, Role: FOLLOWER
I20260811 11:49:50.589874 16132 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6f6820a3ec54f40bcce84cb128ee421 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f8764c9deb445049756ef9f8e0c2de9" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45701 } } peers { permanent_uuid: "2426885362f7480187b6002211efe9cf" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } } peers { permanent_uuid: "d6f6820a3ec54f40bcce84cb128ee421" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } }
I20260811 11:49:50.590320 16157 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6f6820a3ec54f40bcce84cb128ee421 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f8764c9deb445049756ef9f8e0c2de9" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45701 } } peers { permanent_uuid: "2426885362f7480187b6002211efe9cf" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } } peers { permanent_uuid: "d6f6820a3ec54f40bcce84cb128ee421" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } } }
I20260811 11:49:50.590453 16157 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6f6820a3ec54f40bcce84cb128ee421 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:49:50.591362 16132 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6f6820a3ec54f40bcce84cb128ee421 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 11:49:50.597257 16169 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d6f6820a3ec54f40bcce84cb128ee421: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:49:50.597361 16169 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:49:50.595489 16051 master_runner.cc:186] Error getting master registration for 127.20.244.126:45701: OK, instance_id { permanent_uuid: "9f8764c9deb445049756ef9f8e0c2de9" instance_seqno: 1786448990045293 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 11:49:50.598448 16051 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 11:49:50.689724 15952 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } attempt: 4
Aug 11 11:49:50 dist-test-slave-vkjp krb5kdc[15854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448989, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for kudu/127.20.244.124@KRBTEST.COM
I20260811 11:49:50.699985 16139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.690461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48200 (local address 127.20.244.124:44091)
0811 11:49:50.690624 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.690628 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.690773 (+ 145us) server_negotiation.cc:407] Connection header received
0811 11:49:50.690943 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.690946 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.691042 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.691197 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.691740 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.692549 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.693437 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.693789 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.693893 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.696381 (+ 2488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:50.696384 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:50.696386 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:50.696413 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:50.698108 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.698633 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.698636 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.698638 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.698730 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.699043 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.699046 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.699048 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.699301 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:50.699410 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:50.699721 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 11:49:50.699842 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 11:49:50.699996 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.690406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:44091 (local address 127.0.0.1:48200)
0811 11:49:50.690652 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:50.690670 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:50.690820 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:50.691208 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:50.691211 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:50.691461 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:50.691593 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:50.691600 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.692691 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.692694 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:50.693317 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:50.693332 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.693916 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.693919 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:50.694014 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.694569 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:50.694591 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:50.696220 (+ 1629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:50.698240 (+ 2020us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:50.698246 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:50.698248 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:50.698537 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:50.698833 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:50.698838 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:50.698840 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:50.698935 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:50.699426 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:50.699430 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:50.699535 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 11:49:50.699647 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 11:49:50.699802 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163}
I20260811 11:49:50.704035 15952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9: Bootstrap starting.
I20260811 11:49:50.707278 15952 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:50.708245 15952 log.cc:824] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:50.710732 15952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9: No bootstrap required, opened a new log
I20260811 11:49:50.714000 15952 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f8764c9deb445049756ef9f8e0c2de9" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45701 } } peers { permanent_uuid: "2426885362f7480187b6002211efe9cf" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } } peers { permanent_uuid: "d6f6820a3ec54f40bcce84cb128ee421" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } }
I20260811 11:49:50.714257 15952 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f8764c9deb445049756ef9f8e0c2de9, State: Initialized, Role: FOLLOWER
I20260811 11:49:50.714617 15952 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f8764c9deb445049756ef9f8e0c2de9" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45701 } } peers { permanent_uuid: "2426885362f7480187b6002211efe9cf" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } } peers { permanent_uuid: "d6f6820a3ec54f40bcce84cb128ee421" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } }
I20260811 11:49:50.715247 16175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f8764c9deb445049756ef9f8e0c2de9" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45701 } } peers { permanent_uuid: "2426885362f7480187b6002211efe9cf" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } } peers { permanent_uuid: "d6f6820a3ec54f40bcce84cb128ee421" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } } }
I20260811 11:49:50.715498 16175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:49:50.716156 15952 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:50.716253 15920 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 11:49:50.716428 15920 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:50.718672 15920 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f8764c9deb445049756ef9f8e0c2de9" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45701 } } peers { permanent_uuid: "2426885362f7480187b6002211efe9cf" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } } peers { permanent_uuid: "d6f6820a3ec54f40bcce84cb128ee421" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } }
I20260811 11:49:50.719939 15920 leader_election.cc:288] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9 [CANDIDATE]: Term 1 election: Requested vote from peers 2426885362f7480187b6002211efe9cf (127.20.244.125:42263), d6f6820a3ec54f40bcce84cb128ee421 (127.20.244.124:44091)
I20260811 11:49:50.721138 16011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9f8764c9deb445049756ef9f8e0c2de9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2426885362f7480187b6002211efe9cf"
I20260811 11:49:50.721432 16011 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2426885362f7480187b6002211efe9cf [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:50.722021 16102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9f8764c9deb445049756ef9f8e0c2de9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d6f6820a3ec54f40bcce84cb128ee421"
I20260811 11:49:50.722254 16102 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6f6820a3ec54f40bcce84cb128ee421 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:50.722973 16011 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2426885362f7480187b6002211efe9cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f8764c9deb445049756ef9f8e0c2de9 in term 1.
I20260811 11:49:50.723630 16102 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d6f6820a3ec54f40bcce84cb128ee421 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f8764c9deb445049756ef9f8e0c2de9 in term 1.
I20260811 11:49:50.724220 15890 leader_election.cc:302] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f8764c9deb445049756ef9f8e0c2de9, d6f6820a3ec54f40bcce84cb128ee421; no voters:
I20260811 11:49:50.724650 16175 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:50.724900 16175 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9 [term 1 LEADER]: Becoming Leader. State: Replica: 9f8764c9deb445049756ef9f8e0c2de9, State: Running, Role: LEADER
I20260811 11:49:50.725330 16175 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f8764c9deb445049756ef9f8e0c2de9" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45701 } } peers { permanent_uuid: "2426885362f7480187b6002211efe9cf" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } } peers { permanent_uuid: "d6f6820a3ec54f40bcce84cb128ee421" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } }
I20260811 11:49:50.727751 16175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f8764c9deb445049756ef9f8e0c2de9. Latest consensus state: current_term: 1 leader_uuid: "9f8764c9deb445049756ef9f8e0c2de9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f8764c9deb445049756ef9f8e0c2de9" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45701 } } peers { permanent_uuid: "2426885362f7480187b6002211efe9cf" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } } peers { permanent_uuid: "d6f6820a3ec54f40bcce84cb128ee421" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } } }
I20260811 11:49:50.727944 16175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:50.728422 16193 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:50.731920 16193 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:50.733150 15869 master_runner.cc:263] No leader master found from master 9f8764c9deb445049756ef9f8e0c2de9
I20260811 11:49:50.733234 15869 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 11:49:50.741202 16102 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d6f6820a3ec54f40bcce84cb128ee421 [term 1 FOLLOWER]: Refusing update from remote peer 9f8764c9deb445049756ef9f8e0c2de9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:49:50.741994 16191 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6f6820a3ec54f40bcce84cb128ee421" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:49:50.746308 16157 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6f6820a3ec54f40bcce84cb128ee421 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f8764c9deb445049756ef9f8e0c2de9. Latest consensus state: current_term: 1 leader_uuid: "9f8764c9deb445049756ef9f8e0c2de9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f8764c9deb445049756ef9f8e0c2de9" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45701 } } peers { permanent_uuid: "2426885362f7480187b6002211efe9cf" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } } peers { permanent_uuid: "d6f6820a3ec54f40bcce84cb128ee421" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } } }
I20260811 11:49:50.746464 16157 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6f6820a3ec54f40bcce84cb128ee421 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:49:50.747792 16011 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2426885362f7480187b6002211efe9cf [term 1 FOLLOWER]: Refusing update from remote peer 9f8764c9deb445049756ef9f8e0c2de9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:49:50.748540 16191 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2426885362f7480187b6002211efe9cf" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:49:50.752269 16140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.733688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58842 (local address 127.20.244.126:45701)
0811 11:49:50.733846 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.733851 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.735288 (+ 1437us) server_negotiation.cc:407] Connection header received
0811 11:49:50.735496 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.735499 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.735551 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.735605 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.736709 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.737456 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.741507 (+ 4051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.741857 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.741958 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.748129 (+ 6171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:50.748133 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:50.748137 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:50.748172 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:50.750135 (+ 1963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.750684 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.750688 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.750690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.750784 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.751152 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.751155 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.751157 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.751414 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:50.751553 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:50.751942 (+ 389us) server_negotiation.cc:299] Negotiation successful
0811 11:49:50.752104 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 11:49:50.755113 16143 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2426885362f7480187b6002211efe9cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f8764c9deb445049756ef9f8e0c2de9. Latest consensus state: current_term: 1 leader_uuid: "9f8764c9deb445049756ef9f8e0c2de9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f8764c9deb445049756ef9f8e0c2de9" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45701 } } peers { permanent_uuid: "2426885362f7480187b6002211efe9cf" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } } peers { permanent_uuid: "d6f6820a3ec54f40bcce84cb128ee421" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } } }
I20260811 11:49:50.755275 16143 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2426885362f7480187b6002211efe9cf [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:49:50.757344 16139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.734636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48212 (local address 127.20.244.124:44091)
0811 11:49:50.734746 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.734750 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.739374 (+ 4624us) server_negotiation.cc:407] Connection header received
0811 11:49:50.739583 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.739587 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.739640 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.739697 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.740732 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.741489 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.743191 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.743521 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.743607 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.752148 (+ 8541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:50.752152 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:50.752155 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:50.752188 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:50.753989 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.755734 (+ 1745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.755739 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.755741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.755860 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.756230 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.756234 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.756236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.756474 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:50.756618 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:50.757022 (+ 404us) server_negotiation.cc:299] Negotiation successful
0811 11:49:50.757149 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 11:49:50.760428 16191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9f8764c9deb445049756ef9f8e0c2de9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f8764c9deb445049756ef9f8e0c2de9" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45701 } } peers { permanent_uuid: "2426885362f7480187b6002211efe9cf" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } } peers { permanent_uuid: "d6f6820a3ec54f40bcce84cb128ee421" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } } }
I20260811 11:49:50.760614 16191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:50.761410 16175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9f8764c9deb445049756ef9f8e0c2de9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f8764c9deb445049756ef9f8e0c2de9" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45701 } } peers { permanent_uuid: "2426885362f7480187b6002211efe9cf" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } } peers { permanent_uuid: "d6f6820a3ec54f40bcce84cb128ee421" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } } }
I20260811 11:49:50.761535 16175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:50.761888 16143 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2426885362f7480187b6002211efe9cf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9f8764c9deb445049756ef9f8e0c2de9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f8764c9deb445049756ef9f8e0c2de9" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45701 } } peers { permanent_uuid: "2426885362f7480187b6002211efe9cf" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } } peers { permanent_uuid: "d6f6820a3ec54f40bcce84cb128ee421" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } } }
I20260811 11:49:50.762020 16143 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2426885362f7480187b6002211efe9cf [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:49:50.762872 16142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:50.734521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49872 (local address 127.20.244.125:42263)
0811 11:49:50.734659 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.734664 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.738906 (+ 4242us) server_negotiation.cc:407] Connection header received
0811 11:49:50.739194 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.739198 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.739284 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.739342 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.742944 (+ 3602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.743709 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.750871 (+ 7162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:50.751321 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:50.751406 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:50.758080 (+ 6674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:50.758084 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:50.758087 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:50.758119 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:50.759950 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.760492 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.760497 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.760498 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.760594 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:50.760951 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:50.760954 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:50.760956 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:50.761223 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:50.761335 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:50.761732 (+ 397us) server_negotiation.cc:299] Negotiation successful
0811 11:49:50.761882 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 11:49:50.762800 16157 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6f6820a3ec54f40bcce84cb128ee421 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9f8764c9deb445049756ef9f8e0c2de9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f8764c9deb445049756ef9f8e0c2de9" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 45701 } } peers { permanent_uuid: "2426885362f7480187b6002211efe9cf" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 42263 } } peers { permanent_uuid: "d6f6820a3ec54f40bcce84cb128ee421" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 44091 } } }
I20260811 11:49:50.762965 16157 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6f6820a3ec54f40bcce84cb128ee421 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:49:50.764042 16199 mvcc.cc:205] Tried to move back new op lower bound from 7317295066058797056 to 7317295066016280576. Current Snapshot: MvccSnapshot[applied={T|T < 7317295066058797056}]
I20260811 11:49:50.764689 16205 mvcc.cc:205] Tried to move back new op lower bound from 7317295066058797056 to 7317295066016280576. Current Snapshot: MvccSnapshot[applied={T|T < 7317295066058797056}]
I20260811 11:49:50.764907 16202 mvcc.cc:205] Tried to move back new op lower bound from 7317295066058797056 to 7317295066016280576. Current Snapshot: MvccSnapshot[applied={T|T < 7317295066058797056}]
I20260811 11:49:50.774154 16193 catalog_manager.cc:1347] Generated new cluster ID: 69c6a10311a0433abdd316da0c4eed26
I20260811 11:49:50.774281 16193 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:50.808714 16193 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:50.811856 16193 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:50.828639 16193 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9f8764c9deb445049756ef9f8e0c2de9: Generated new TSK 0
I20260811 11:49:50.829768 16193 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 11:49:50.850566 16142 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:50.849109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49878 (local address 127.20.244.125:42263)
0811 11:49:50.849225 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.849229 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.849245 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:49:50.849505 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.849509 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.849566 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.849629 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.850407 (+ 778us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49878: BlockingRecv error: recv got EOF from 127.0.0.1:49878 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260811 11:49:50.850617 16140 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:50.848722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58856 (local address 127.20.244.126:45701)
0811 11:49:50.848876 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.848881 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.849477 (+ 596us) server_negotiation.cc:407] Connection header received
0811 11:49:50.849674 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.849677 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.849736 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.849829 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.850489 (+ 660us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58856: BlockingRecv error: recv got EOF from 127.0.0.1:58856 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260811 11:49:50.851294 16139 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:50.848803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48220 (local address 127.20.244.124:44091)
0811 11:49:50.848948 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.848953 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.849875 (+ 922us) server_negotiation.cc:407] Connection header received
0811 11:49:50.850065 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.850069 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.850126 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.850180 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.851170 (+ 990us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48220: BlockingRecv error: recv got EOF from 127.0.0.1:48220 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260811 11:49:50.854552 16142 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:50.853399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49892 (local address 127.20.244.125:42263)
0811 11:49:50.853529 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.853533 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.853662 (+ 129us) server_negotiation.cc:407] Connection header received
0811 11:49:50.853881 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.853884 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.853951 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.854044 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.854447 (+ 403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49892: BlockingRecv error: recv got EOF from 127.0.0.1:49892 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260811 11:49:50.858768 16142 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:50.857959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49898 (local address 127.20.244.125:42263)
0811 11:49:50.858088 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.858093 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.858106 (+ 13us) server_negotiation.cc:407] Connection header received
0811 11:49:50.858153 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.858156 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.858207 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.858291 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.858668 (+ 377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49898: BlockingRecv error: recv got EOF from 127.0.0.1:49898 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260811 11:49:50.863787 16142 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:50.862600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49906 (local address 127.20.244.125:42263)
0811 11:49:50.862726 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.862731 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.862880 (+ 149us) server_negotiation.cc:407] Connection header received
0811 11:49:50.863030 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.863033 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.863177 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.863272 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.863689 (+ 417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49906: BlockingRecv error: recv got EOF from 127.0.0.1:49906 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260811 11:49:50.870712 16142 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:50.869564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49908 (local address 127.20.244.125:42263)
0811 11:49:50.869743 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.869748 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.869837 (+ 89us) server_negotiation.cc:407] Connection header received
0811 11:49:50.870011 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.870015 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.870070 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.870157 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.870594 (+ 437us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49908: BlockingRecv error: recv got EOF from 127.0.0.1:49908 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
W20260811 11:49:50.882447 16142 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:50.881071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49910 (local address 127.20.244.125:42263)
0811 11:49:50.881201 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.881204 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.881513 (+ 309us) server_negotiation.cc:407] Connection header received
0811 11:49:50.881682 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.881685 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.881752 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.881851 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.882323 (+ 472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49910: BlockingRecv error: recv got EOF from 127.0.0.1:49910 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260811 11:49:50.902508 16142 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:50.901137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49924 (local address 127.20.244.125:42263)
0811 11:49:50.901313 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.901319 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.901527 (+ 208us) server_negotiation.cc:407] Connection header received
0811 11:49:50.901652 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.901656 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.901721 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.901846 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.902384 (+ 538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49924: BlockingRecv error: recv got EOF from 127.0.0.1:49924 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260811 11:49:50.938323 16142 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:50.936883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49938 (local address 127.20.244.125:42263)
0811 11:49:50.937060 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:50.937063 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:50.937261 (+ 198us) server_negotiation.cc:407] Connection header received
0811 11:49:50.937474 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:50.937478 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:50.937529 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:50.937607 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:50.938179 (+ 572us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49938: BlockingRecv error: recv got EOF from 127.0.0.1:49938 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260811 11:49:51.006266 16142 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:51.004943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49946 (local address 127.20.244.125:42263)
0811 11:49:51.005122 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:51.005127 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:51.005262 (+ 135us) server_negotiation.cc:407] Connection header received
0811 11:49:51.005518 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:51.005528 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:51.005578 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:51.005673 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:51.006148 (+ 475us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49946: BlockingRecv error: recv got EOF from 127.0.0.1:49946 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260811 11:49:51.138319 16142 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:51.136817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49956 (local address 127.20.244.125:42263)
0811 11:49:51.137021 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:51.137027 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:51.137201 (+ 174us) server_negotiation.cc:407] Connection header received
0811 11:49:51.137485 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:51.137489 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:51.137551 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:51.137657 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:51.138197 (+ 540us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49956: BlockingRecv error: recv got EOF from 127.0.0.1:49956 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
W20260811 11:49:51.398087 16142 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:51.396887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49966 (local address 127.20.244.125:42263)
0811 11:49:51.397048 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:51.397053 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:51.397073 (+ 20us) server_negotiation.cc:407] Connection header received
0811 11:49:51.397258 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:51.397262 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:51.397328 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:51.397439 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:51.397956 (+ 517us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49966: BlockingRecv error: recv got EOF from 127.0.0.1:49966 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 11:49:51.577550 16154 catalog_manager.cc:1259] Loaded cluster ID: 69c6a10311a0433abdd316da0c4eed26
I20260811 11:49:51.577639 16154 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2426885362f7480187b6002211efe9cf: loading cluster ID for follower catalog manager: success
I20260811 11:49:51.579463 16154 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2426885362f7480187b6002211efe9cf: acquiring CA information for follower catalog manager: success
I20260811 11:49:51.580621 16154 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2426885362f7480187b6002211efe9cf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 11:49:51.598589 16169 catalog_manager.cc:1259] Loaded cluster ID: 69c6a10311a0433abdd316da0c4eed26
I20260811 11:49:51.598685 16169 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d6f6820a3ec54f40bcce84cb128ee421: loading cluster ID for follower catalog manager: success
I20260811 11:49:51.600404 16169 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d6f6820a3ec54f40bcce84cb128ee421: acquiring CA information for follower catalog manager: success
I20260811 11:49:51.601547 16169 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d6f6820a3ec54f40bcce84cb128ee421: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 11:49:51.916926 16285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:51.912640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49980 (local address 127.20.244.125:42263)
0811 11:49:51.912902 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:51.912906 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:51.912925 (+ 19us) server_negotiation.cc:407] Connection header received
0811 11:49:51.913090 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:51.913093 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:51.913225 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:51.913327 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:49:51.913656 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:51.914211 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:51.915222 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:51.915448 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:51.915528 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:51.915921 (+ 393us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:49:51.916392 (+ 471us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:49:51.916497 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:51.916674 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 11:49:51.916732 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":77,"threads_started":1}
I20260811 11:49:51.924871 16292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:51.920542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48230 (local address 127.20.244.124:44091)
0811 11:49:51.920777 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:51.920781 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:51.920797 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:49:51.921003 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:51.921006 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:51.921125 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:51.921228 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:49:51.921457 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:51.922229 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:51.923174 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:51.923467 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:51.923561 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:51.923880 (+ 319us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:49:51.924412 (+ 532us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:49:51.924534 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:51.924597 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 11:49:51.924700 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":84,"threads_started":1}
I20260811 11:49:51.933305 16292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:51.928885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48242 (local address 127.20.244.124:44091)
0811 11:49:51.929013 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:51.929019 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:51.929325 (+ 306us) server_negotiation.cc:407] Connection header received
0811 11:49:51.929459 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:51.929462 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:51.929509 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:51.929575 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:49:51.929986 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:51.930879 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:51.931905 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:51.932146 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:51.932261 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:51.932588 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:49:51.932671 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:49:51.932746 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:51.933105 (+ 359us) server_negotiation.cc:299] Negotiation successful
0811 11:49:51.933166 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 11:49:51.933821 16285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:51.928519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49982 (local address 127.20.244.125:42263)
0811 11:49:51.928694 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:51.928702 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:51.929300 (+ 598us) server_negotiation.cc:407] Connection header received
0811 11:49:51.929528 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:51.929533 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:51.929602 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:51.929665 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:49:51.930134 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:51.930995 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:51.932437 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:51.932777 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:51.932896 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:51.933227 (+ 331us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:49:51.933305 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:49:51.933382 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:51.933596 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 11:49:51.933667 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 11:49:51.933846 16299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:51.928483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58862 (local address 127.20.244.126:45701)
0811 11:49:51.928751 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:51.928755 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:51.928951 (+ 196us) server_negotiation.cc:407] Connection header received
0811 11:49:51.929171 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:51.929174 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:51.929331 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:51.929480 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:49:51.929750 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:51.930376 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:51.931394 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:51.931805 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:51.931932 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:51.932612 (+ 680us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:49:51.932986 (+ 374us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:49:51.933097 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:51.933596 (+ 499us) server_negotiation.cc:299] Negotiation successful
0811 11:49:51.933673 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":75,"threads_started":1}
I20260811 11:49:51.938148 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 15869
I20260811 11:49:51.950395 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 15961
I20260811 11:49:51.960541 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 16051
2026-08-11T11:49:51Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3410 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:49:52 dist-test-slave-vkjp krb5kdc[16303](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:49:52 dist-test-slave-vkjp krb5kdc[16303](info): set up 2 sockets
Aug 11 11:49:52 dist-test-slave-vkjp krb5kdc[16303](info): commencing operation
krb5kdc: starting...
W20260811 11:49:53.132498 21457 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/test-user.keytab.
Aug 11 11:49:53 dist-test-slave-vkjp krb5kdc[16303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:49:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:49:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.244.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
Entry for principal kudu/127.20.244.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab.
I20260811 11:49:53.270784 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:39213
--webserver_interface=127.20.244.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:43349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:39213,127.20.244.125:33439,127.20.244.124:38163
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:49:53.390502 16318 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 11:49:53.390839 16318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:53.390864 16318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:53.390904 16318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:53.394958 16318 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:53.395031 16318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:53.395051 16318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:53.395068 16318 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:53.395102 16318 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:53.400669 16318 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:43349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:39213,127.20.244.125:33439,127.20.244.124:38163
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.126.keytab
--principal=kudu/127.20.244.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.126:39213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.244.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:53.401775 16318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:53.402766 16318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:53.412253 16326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:53.412343 16318 server_base.cc:1034] running on GCE node
W20260811 11:49:53.412257 16325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:53.412297 16328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:53.413257 16318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:53.414503 16318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:53.415714 16318 hybrid_clock.cc:648] HybridClock initialized: now 1786448993415680 us; error 44 us; skew 500 ppm
Aug 11 11:49:53 dist-test-slave-vkjp krb5kdc[16303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448993, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:53.418721 16318 init.cc:377] Logged in from keytab as kudu/127.20.244.126@KRBTEST.COM (short username kudu)
I20260811 11:49:53.419741 16318 webserver.cc:460] Webserver started at http://127.20.244.126:34811/ using document root <none> and password file <none>
I20260811 11:49:53.420347 16318 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:53.420452 16318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:53.420693 16318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:53.422914 16318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-0/data/instance:
uuid: "af7be10cc48a4adeaef731f3b68ba474"
format_stamp: "Formatted at 2026-08-11 11:49:53 on dist-test-slave-vkjp"
server_key: "08653d5dced967fc74d0c1efa723c50f"
server_key_iv: "900c98ddfa4fded62ce89d59d5636e0a"
server_key_version: "encryptionkey@0"
I20260811 11:49:53.423578 16318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-0/wal/instance:
uuid: "af7be10cc48a4adeaef731f3b68ba474"
format_stamp: "Formatted at 2026-08-11 11:49:53 on dist-test-slave-vkjp"
server_key: "08653d5dced967fc74d0c1efa723c50f"
server_key_iv: "900c98ddfa4fded62ce89d59d5636e0a"
server_key_version: "encryptionkey@0"
I20260811 11:49:53.427630 16318 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 11:49:53.430321 16336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:53.431718 16318 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 11:49:53.431874 16318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-0/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-0/wal
uuid: "af7be10cc48a4adeaef731f3b68ba474"
format_stamp: "Formatted at 2026-08-11 11:49:53 on dist-test-slave-vkjp"
server_key: "08653d5dced967fc74d0c1efa723c50f"
server_key_iv: "900c98ddfa4fded62ce89d59d5636e0a"
server_key_version: "encryptionkey@0"
I20260811 11:49:53.431995 16318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:53.448506 16318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:53.451622 16318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:53.451792 16318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:53.459362 16318 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.126:39213
I20260811 11:49:53.459661 16396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.126:39213 every 8 connection(s)
I20260811 11:49:53.460397 16318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-0/data/info.pb
I20260811 11:49:53.463383 16397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:53.467379 16397 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39213 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:49:53.469144 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 16318
I20260811 11:49:53.469312 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-0/wal/instance
I20260811 11:49:53.469622 21457 external_mini_cluster.cc:1428] Setting key 224f1777e4f34dd65efaebc58d09ef25
Aug 11 11:49:53 dist-test-slave-vkjp krb5kdc[16303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448993, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.244.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.125@KRBTEST.COM" created.
I20260811 11:49:53.483803 16399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.469898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56084 (local address 127.20.244.126:39213)
0811 11:49:53.470479 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:53.470502 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:53.470754 (+ 252us) server_negotiation.cc:407] Connection header received
0811 11:49:53.471927 (+ 1173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:53.471931 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:53.472125 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:53.472319 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:53.473200 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.474076 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.475065 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.475492 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.475669 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:53.478255 (+ 2586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:53.478262 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:53.478273 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:53.478295 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:53.480231 (+ 1936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.480805 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.480813 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.480815 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.480928 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.481302 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.481307 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.481309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.481792 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:53.481945 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:53.482341 (+ 396us) server_negotiation.cc:299] Negotiation successful
0811 11:49:53.482685 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":123,"server-negotiator.queue_time_us":376,"thread_start_us":167,"threads_started":1}
I20260811 11:49:53.483803 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.469898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39213 (local address 127.0.0.1:56084)
0811 11:49:53.470572 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.470625 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:53.471591 (+ 966us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:53.472319 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:53.472325 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:53.472788 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:53.473046 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:53.473061 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.474205 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.474209 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:53.474935 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:53.474944 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.475658 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.475662 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:53.475756 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:53.476450 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:53.476470 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:53.478012 (+ 1542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:53.480362 (+ 2350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:53.480371 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:53.480383 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:53.480682 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:53.481054 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:53.481060 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:53.481065 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:53.481206 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:53.481913 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:53.481920 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:53.482081 (+ 161us) client_negotiation.cc:769] Sending connection context
0811 11:49:53.482261 (+ 180us) client_negotiation.cc:240] Negotiation successful
0811 11:49:53.482633 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"spinlock_wait_cycles":89088,"thread_start_us":167,"threads_started":1}
I20260811 11:49:53.486317 16397 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:49:53.487187 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.486820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:33439 (local address 127.0.0.1:43434)
0811 11:49:53.486943 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.487059 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.125:33439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 11:49:53.487382 16338 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.244.125:33439: connect: Connection refused (error 111)
I20260811 11:49:53.488382 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.488143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:33439 (local address 127.0.0.1:43442)
0811 11:49:53.488258 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.488307 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.125:33439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 11:49:53.488571 16397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.125:33439: Network error: Client connection negotiation failed: client connection to 127.20.244.125:33439: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.125.keytab.
Entry for principal kudu/127.20.244.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.125.keytab.
I20260811 11:49:53.500176 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.125:33439
--webserver_interface=127.20.244.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.125.keytab
--principal=kudu/127.20.244.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:43349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:39213,127.20.244.125:33439,127.20.244.124:38163
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:49:53.537840 16397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } attempt: 1
I20260811 11:49:53.538743 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.538429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:33439 (local address 127.0.0.1:43458)
0811 11:49:53.538587 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.538661 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.125:33439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 11:49:53.539618 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.539391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:33439 (local address 127.0.0.1:43474)
0811 11:49:53.539510 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.539560 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.125:33439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 11:49:53.539788 16397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.125:33439: Network error: Client connection negotiation failed: client connection to 127.20.244.125:33439: connect: Connection refused (error 111)
I20260811 11:49:53.607980 16397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } attempt: 2
I20260811 11:49:53.608857 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.608547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:33439 (local address 127.0.0.1:43490)
0811 11:49:53.608696 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.608775 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.125:33439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260811 11:49:53.609664 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.609436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:33439 (local address 127.0.0.1:43496)
0811 11:49:53.609551 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.609601 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.125:33439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 11:49:53.609844 16397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.125:33439: Network error: Client connection negotiation failed: client connection to 127.20.244.125:33439: connect: Connection refused (error 111)
W20260811 11:49:53.623078 16404 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 11:49:53.623482 16404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:53.623555 16404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:53.623633 16404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:53.627876 16404 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:53.627941 16404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:53.627961 16404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:53.627979 16404 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:53.627995 16404 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:53.633594 16404 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:43349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:39213,127.20.244.125:33439,127.20.244.124:38163
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.125.keytab
--principal=kudu/127.20.244.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.125:33439
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.244.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16404
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:53.634806 16404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:53.635958 16404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:53.645048 16409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:53.645048 16410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:53.645200 16412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:53.645112 16404 server_base.cc:1034] running on GCE node
I20260811 11:49:53.645936 16404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:53.647285 16404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:53.648468 16404 hybrid_clock.cc:648] HybridClock initialized: now 1786448993648447 us; error 33 us; skew 500 ppm
Aug 11 11:49:53 dist-test-slave-vkjp krb5kdc[16303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448993, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:53.651460 16404 init.cc:377] Logged in from keytab as kudu/127.20.244.125@KRBTEST.COM (short username kudu)
I20260811 11:49:53.652453 16404 webserver.cc:460] Webserver started at http://127.20.244.125:35317/ using document root <none> and password file <none>
I20260811 11:49:53.653088 16404 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:53.653154 16404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:53.653416 16404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:53.655684 16404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-1/data/instance:
uuid: "9c2e2ee68ac14565bfe504539e300554"
format_stamp: "Formatted at 2026-08-11 11:49:53 on dist-test-slave-vkjp"
server_key: "d79b585b32e730049503adbc71600a6f"
server_key_iv: "59cf80637da14b4189669833c8286fe9"
server_key_version: "encryptionkey@0"
I20260811 11:49:53.656289 16404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-1/wal/instance:
uuid: "9c2e2ee68ac14565bfe504539e300554"
format_stamp: "Formatted at 2026-08-11 11:49:53 on dist-test-slave-vkjp"
server_key: "d79b585b32e730049503adbc71600a6f"
server_key_iv: "59cf80637da14b4189669833c8286fe9"
server_key_version: "encryptionkey@0"
I20260811 11:49:53.660612 16404 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 11:49:53.663254 16421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:53.664508 16404 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 11:49:53.664762 16404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-1/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-1/wal
uuid: "9c2e2ee68ac14565bfe504539e300554"
format_stamp: "Formatted at 2026-08-11 11:49:53 on dist-test-slave-vkjp"
server_key: "d79b585b32e730049503adbc71600a6f"
server_key_iv: "59cf80637da14b4189669833c8286fe9"
server_key_version: "encryptionkey@0"
I20260811 11:49:53.664901 16404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:53.683669 16404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:53.687295 16404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:53.687518 16404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:53.695043 16404 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.125:33439
I20260811 11:49:53.695394 16482 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.125:33439 every 8 connection(s)
I20260811 11:49:53.696116 16404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-1/data/info.pb
I20260811 11:49:53.698105 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 16404
I20260811 11:49:53.698215 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-1/wal/instance
I20260811 11:49:53.698567 21457 external_mini_cluster.cc:1428] Setting key fdb1727118cd1a2ebf2987965b4a2045
I20260811 11:49:53.699133 16483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:53.701035 16397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } attempt: 3
I20260811 11:49:53.703696 16483 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39213 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.20.244.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.244.124@KRBTEST.COM" created.
Aug 11 11:49:53 dist-test-slave-vkjp krb5kdc[16303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448993, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for kudu/127.20.244.125@KRBTEST.COM
Aug 11 11:49:53 dist-test-slave-vkjp krb5kdc[16303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448993, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.125@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:49:53.717425 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.701629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:33439 (local address 127.0.0.1:43502)
0811 11:49:53.701859 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.701876 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:53.701974 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:53.704847 (+ 2873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:53.704854 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:53.705096 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:53.705281 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:53.705292 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.707313 (+ 2021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.707319 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:53.708250 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:53.708264 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.709304 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.709307 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:53.709469 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:53.710077 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:53.710090 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:53.712332 (+ 2242us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:53.714955 (+ 2623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:53.714960 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:53.714962 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:53.715317 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:53.715803 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:53.715809 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:53.715814 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:53.715913 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:53.716797 (+ 884us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:53.716803 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:53.716962 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 11:49:53.717067 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 11:49:53.717222 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":56}
I20260811 11:49:53.717782 16399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.705974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56092 (local address 127.20.244.126:39213)
0811 11:49:53.706102 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:53.706107 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:53.706544 (+ 437us) server_negotiation.cc:407] Connection header received
0811 11:49:53.706767 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:53.706770 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:53.706816 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:53.706863 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:53.707744 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.708240 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.709403 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.709765 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.709872 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:53.713237 (+ 3365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:53.713244 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:53.713250 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:53.713284 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:53.715736 (+ 2452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.716309 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.716314 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.716316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.716404 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.716701 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.716706 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.716707 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.716967 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:53.717069 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:53.717509 (+ 440us) server_negotiation.cc:299] Negotiation successful
0811 11:49:53.717632 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":50}
I20260811 11:49:53.718815 16488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.705959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39213 (local address 127.0.0.1:56092)
0811 11:49:53.706417 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.706467 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:53.706659 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:53.707032 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:53.707039 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:53.707489 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:53.707610 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:53.707615 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.708366 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.708372 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:53.709282 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:53.709291 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.709936 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.709942 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:53.710083 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:53.710623 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:53.710647 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:53.713033 (+ 2386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:53.715948 (+ 2915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:53.715960 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:53.715967 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:53.716202 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:53.716500 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:53.716504 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:53.716506 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:53.716606 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:53.717128 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:53.717135 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:53.717263 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 11:49:53.718027 (+ 764us) client_negotiation.cc:240] Negotiation successful
0811 11:49:53.718187 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"spinlock_wait_cycles":768,"thread_start_us":183,"threads_started":1}
I20260811 11:49:53.718822 16487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.702465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43502 (local address 127.20.244.125:33439)
0811 11:49:53.702964 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:53.702984 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:53.703056 (+ 72us) server_negotiation.cc:407] Connection header received
0811 11:49:53.703989 (+ 933us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:53.704015 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:53.704484 (+ 469us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:53.704865 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:53.705477 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.707167 (+ 1690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.708400 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.709138 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.709303 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:53.712538 (+ 3235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:53.712549 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:53.712566 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:53.712601 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:53.714803 (+ 2202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.715507 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.715514 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.715523 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.715674 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.716038 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.716043 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.716048 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.716660 (+ 612us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:53.716883 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:53.717258 (+ 375us) server_negotiation.cc:299] Negotiation successful
0811 11:49:53.717803 (+ 545us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":336,"thread_start_us":140,"threads_started":1}
I20260811 11:49:53.720443 16483 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:49:53.720969 16397 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:49:53.721726 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.721437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:38163 (local address 127.0.0.1:33160)
0811 11:49:53.721589 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.721647 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 11:49:53.722685 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.722424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:38163 (local address 127.0.0.1:33168)
0811 11:49:53.722580 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.722625 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
W20260811 11:49:53.722856 16397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.124:38163: Network error: Client connection negotiation failed: client connection to 127.20.244.124:38163: connect: Connection refused (error 111)
Aug 11 11:49:53 dist-test-slave-vkjp krb5kdc[16303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448993, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.125@KRBTEST.COM for kudu/127.20.244.125@KRBTEST.COM
I20260811 11:49:53.729950 16488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.720987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:33439 (local address 127.0.0.1:43510)
0811 11:49:53.721217 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.721234 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:53.721313 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:53.721683 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:53.721686 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:53.721878 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:53.721966 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:53.721971 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.722948 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.722953 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:53.723564 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:53.723572 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.724145 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.724148 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:53.724216 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:53.724726 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:53.724738 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:53.726222 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:53.728162 (+ 1940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:53.728165 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:53.728166 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:53.728378 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:53.728772 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:53.728774 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:53.728776 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:53.728874 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:53.729382 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:53.729385 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:53.729472 (+ 87us) client_negotiation.cc:769] Sending connection context
0811 11:49:53.729565 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 11:49:53.729783 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135}
I20260811 11:49:53.729967 16487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.721283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43510 (local address 127.20.244.125:33439)
0811 11:49:53.721405 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:53.721409 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:53.721419 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:49:53.721446 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:53.721448 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:53.721512 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:53.721579 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:53.722077 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.722806 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.723778 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.724019 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.724114 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:53.726370 (+ 2256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:53.726373 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:53.726375 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:53.726398 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:53.728028 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.728540 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.728546 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.728550 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.728662 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.728999 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.729048 (+ 49us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.729052 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.729261 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:53.729347 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:53.729688 (+ 341us) server_negotiation.cc:299] Negotiation successful
0811 11:49:53.729833 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":57}
I20260811 11:49:53.730870 16483 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.244.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.124.keytab.
Entry for principal kudu/127.20.244.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.124.keytab.
I20260811 11:49:53.731843 16488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.731480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:38163 (local address 127.0.0.1:33176)
0811 11:49:53.731619 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.731735 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 11:49:53.732177 16424 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.244.124:38163: connect: Connection refused (error 111)
I20260811 11:49:53.732604 21457 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVpoijE/build/debug/bin/kudu
/tmp/dist-test-taskVpoijE/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.124:38163
--webserver_interface=127.20.244.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.124.keytab
--principal=kudu/127.20.244.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.244.84:43349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.244.126:39213,127.20.244.125:33439,127.20.244.124:38163
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:49:53.733234 16488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.733007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:38163 (local address 127.0.0.1:33192)
0811 11:49:53.733122 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.733169 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 11:49:53.733472 16483 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.124:38163: Network error: Client connection negotiation failed: client connection to 127.20.244.124:38163: connect: Connection refused (error 111)
I20260811 11:49:53.754048 16397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } attempt: 1
I20260811 11:49:53.754990 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.754655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:38163 (local address 127.0.0.1:33202)
0811 11:49:53.754820 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.754890 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 11:49:53.755854 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.755619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:38163 (local address 127.0.0.1:33204)
0811 11:49:53.755739 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.755794 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 11:49:53.756018 16397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.124:38163: Network error: Client connection negotiation failed: client connection to 127.20.244.124:38163: connect: Connection refused (error 111)
I20260811 11:49:53.782800 16483 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } attempt: 1
I20260811 11:49:53.784078 16488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.783680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:38163 (local address 127.0.0.1:33210)
0811 11:49:53.783893 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.783978 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 11:49:53.784891 16488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.784624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:38163 (local address 127.0.0.1:33218)
0811 11:49:53.784744 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.784805 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 11:49:53.785090 16483 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.124:38163: Network error: Client connection negotiation failed: client connection to 127.20.244.124:38163: connect: Connection refused (error 111)
I20260811 11:49:53.831144 16397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } attempt: 2
I20260811 11:49:53.832001 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.831697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:38163 (local address 127.0.0.1:33228)
0811 11:49:53.831847 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.831912 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 11:49:53.832886 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.832670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:38163 (local address 127.0.0.1:33234)
0811 11:49:53.832782 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.832828 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 11:49:53.833069 16397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.124:38163: Network error: Client connection negotiation failed: client connection to 127.20.244.124:38163: connect: Connection refused (error 111)
I20260811 11:49:53.853267 16483 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } attempt: 2
I20260811 11:49:53.854167 16488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.853806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:38163 (local address 127.0.0.1:33248)
0811 11:49:53.853990 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.854067 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 11:49:53.854957 16488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.854700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:38163 (local address 127.0.0.1:33258)
0811 11:49:53.854821 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.854886 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.244.124:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 11:49:53.855122 16483 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.244.124:38163: Network error: Client connection negotiation failed: client connection to 127.20.244.124:38163: connect: Connection refused (error 111)
W20260811 11:49:53.858530 16491 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 11:49:53.858839 16491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:49:53.858915 16491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:49:53.858999 16491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:49:53.863520 16491 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:49:53.863575 16491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:49:53.863595 16491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:49:53.863649 16491 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:49:53.863685 16491 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:49:53.869179 16491 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.244.84:43349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.244.126:39213,127.20.244.125:33439,127.20.244.124:38163
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/krb5kdc/kudu_127.20.244.124.keytab
--principal=kudu/127.20.244.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.244.124:38163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.244.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 11:09:46 UTC on ccycloud.quasar-pllopi.root.comops.site
build id 4580136
I20260811 11:49:53.870357 16491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:49:53.871500 16491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:49:53.879972 16497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:53.879966 16496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:49:53.880002 16500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:49:53.880273 16491 server_base.cc:1034] running on GCE node
I20260811 11:49:53.880934 16491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:49:53.882148 16491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:49:53.883337 16491 hybrid_clock.cc:648] HybridClock initialized: now 1786448993883321 us; error 28 us; skew 500 ppm
Aug 11 11:49:53 dist-test-slave-vkjp krb5kdc[16303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448993, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:49:53.886072 16491 init.cc:377] Logged in from keytab as kudu/127.20.244.124@KRBTEST.COM (short username kudu)
I20260811 11:49:53.886956 16491 webserver.cc:460] Webserver started at http://127.20.244.124:44005/ using document root <none> and password file <none>
I20260811 11:49:53.887599 16491 fs_manager.cc:359] Metadata directory not provided
I20260811 11:49:53.887697 16491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:49:53.887936 16491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:49:53.890152 16491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-2/data/instance:
uuid: "02d99aa123f34aa4be07395789effe4a"
format_stamp: "Formatted at 2026-08-11 11:49:53 on dist-test-slave-vkjp"
server_key: "f6560fcb8e71f9e82e491b8ef932da14"
server_key_iv: "9d6efffae243607bb337259db422de8d"
server_key_version: "encryptionkey@0"
I20260811 11:49:53.890733 16491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-2/wal/instance:
uuid: "02d99aa123f34aa4be07395789effe4a"
format_stamp: "Formatted at 2026-08-11 11:49:53 on dist-test-slave-vkjp"
server_key: "f6560fcb8e71f9e82e491b8ef932da14"
server_key_iv: "9d6efffae243607bb337259db422de8d"
server_key_version: "encryptionkey@0"
I20260811 11:49:53.894582 16491 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 11:49:53.897142 16510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:49:53.898296 16491 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 11:49:53.898440 16491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-2/data,/tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-2/wal
uuid: "02d99aa123f34aa4be07395789effe4a"
format_stamp: "Formatted at 2026-08-11 11:49:53 on dist-test-slave-vkjp"
server_key: "f6560fcb8e71f9e82e491b8ef932da14"
server_key_iv: "9d6efffae243607bb337259db422de8d"
server_key_version: "encryptionkey@0"
I20260811 11:49:53.898556 16491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:49:53.918637 16491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:49:53.922322 16491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:49:53.922555 16491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:49:53.929795 16491 rpc_server.cc:307] RPC server started. Bound to: 127.20.244.124:38163
I20260811 11:49:53.930106 16569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.244.124:38163 every 8 connection(s)
I20260811 11:49:53.930938 16491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-2/data/info.pb
I20260811 11:49:53.932235 16397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } attempt: 3
I20260811 11:49:53.934077 16570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:49:53.938011 16570 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39213 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:49:53.940623 21457 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVpoijE/build/debug/bin/kudu as pid 16491
I20260811 11:49:53.940768 21457 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVpoijE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786448696706302-21457-0/minicluster-data/master-2/wal/instance
I20260811 11:49:53.941068 21457 external_mini_cluster.cc:1428] Setting key dc7c25e1a45bd3c2046331a4d318f03e
Aug 11 11:49:53 dist-test-slave-vkjp krb5kdc[16303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448993, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.126@KRBTEST.COM for kudu/127.20.244.124@KRBTEST.COM
Aug 11 11:49:53 dist-test-slave-vkjp krb5kdc[16303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448993, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.124@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:49:53.946285 16483 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } attempt: 3
I20260811 11:49:53.946429 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.932834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:38163 (local address 127.0.0.1:33262)
0811 11:49:53.933019 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.933037 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:53.933140 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:53.935789 (+ 2649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:53.935793 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:53.936022 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:53.936143 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:53.936153 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.937574 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.937579 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:53.938123 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:53.938133 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.939139 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.939143 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:53.939233 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:53.939867 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:53.939887 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:53.941664 (+ 1777us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:53.944334 (+ 2670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:53.944346 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:53.944348 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:53.944651 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:53.945022 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:53.945025 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:53.945027 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:53.945120 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:53.945793 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:53.945797 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:53.945920 (+ 123us) client_negotiation.cc:769] Sending connection context
0811 11:49:53.946041 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 11:49:53.946182 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 11:49:53.947926 16572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.933535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33262 (local address 127.20.244.124:38163)
0811 11:49:53.933929 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:53.933950 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:53.933995 (+ 45us) server_negotiation.cc:407] Connection header received
0811 11:49:53.934934 (+ 939us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:53.934952 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:53.935465 (+ 513us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:53.935822 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:53.936291 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.937424 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.938271 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.938984 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.939190 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:53.941848 (+ 2658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:53.941856 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:53.941869 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:53.941908 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:53.944224 (+ 2316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.944757 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.944763 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.944769 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.944920 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.945212 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.945217 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.945218 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.945658 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:53.945806 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:53.946226 (+ 420us) server_negotiation.cc:299] Negotiation successful
0811 11:49:53.946516 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"spinlock_wait_cycles":1280,"thread_start_us":138,"threads_started":1}
Aug 11 11:49:53 dist-test-slave-vkjp krb5kdc[16303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.124@KRBTEST.COM
I20260811 11:49:53.951366 16399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.939673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56098 (local address 127.20.244.126:39213)
0811 11:49:53.939810 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:53.939816 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:53.940267 (+ 451us) server_negotiation.cc:407] Connection header received
0811 11:49:53.940426 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:53.940429 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:53.940481 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:53.940578 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:53.941484 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.942196 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.943508 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.943851 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.943963 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:53.947344 (+ 3381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:53.947351 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:53.947356 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:53.947384 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:53.949305 (+ 1921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.949824 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.949828 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.949830 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.949919 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.950241 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.950245 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.950249 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.950574 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:53.950674 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:53.951034 (+ 360us) server_negotiation.cc:299] Negotiation successful
0811 11:49:53.951187 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 11:49:53.951382 16573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.939666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.126:39213 (local address 127.0.0.1:56098)
0811 11:49:53.940114 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.940169 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:53.940310 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:53.940642 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:53.940651 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:53.941145 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:53.941343 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:53.941353 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.942316 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.942322 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:53.943357 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:53.943373 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.943991 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.943996 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:53.944185 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:53.944750 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:53.944771 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:53.947151 (+ 2380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:53.949411 (+ 2260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:53.949418 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:53.949424 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:53.949701 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:53.950031 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:53.950034 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:53.950036 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:53.950130 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:53.950674 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:53.950682 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:53.950815 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 11:49:53.950963 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 11:49:53.951200 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"mutex_wait_us":53,"thread_start_us":148,"threads_started":1}
I20260811 11:49:53.952935 16570 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:49:53.953552 16397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474: Bootstrap starting.
I20260811 11:49:53.955324 16575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.942028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33268 (local address 127.20.244.124:38163)
0811 11:49:53.942328 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:53.942337 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:53.942350 (+ 13us) server_negotiation.cc:407] Connection header received
0811 11:49:53.942669 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:53.942675 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:53.942730 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:53.942824 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:53.943836 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.944654 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.945914 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.946235 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.946339 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:53.949952 (+ 3613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:53.949957 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:53.949959 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:53.949987 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:53.953002 (+ 3015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.953937 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.953943 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.953946 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.954037 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.954355 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.954359 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.954360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.954547 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:53.954742 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:53.954976 (+ 234us) server_negotiation.cc:299] Negotiation successful
0811 11:49:53.955121 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":233,"thread_start_us":97,"threads_started":1}
Aug 11 11:49:53 dist-test-slave-vkjp krb5kdc[16303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448993, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.125@KRBTEST.COM for kudu/127.20.244.124@KRBTEST.COM
I20260811 11:49:53.956846 16397 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:53.957831 16397 log.cc:824] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474: Log is configured to *not* fsync() on all Append() calls
Aug 11 11:49:53 dist-test-slave-vkjp krb5kdc[16303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448993, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.124@KRBTEST.COM for kudu/127.20.244.125@KRBTEST.COM
Aug 11 11:49:53 dist-test-slave-vkjp krb5kdc[16303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.126@KRBTEST.COM
I20260811 11:49:53.962455 16397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474: No bootstrap required, opened a new log
I20260811 11:49:53.962559 16488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.946704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:38163 (local address 127.0.0.1:33278)
0811 11:49:53.946890 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.946904 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:53.946986 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:53.949737 (+ 2751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:53.949742 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:53.949945 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:53.950086 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:53.950100 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.951821 (+ 1721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.951825 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:53.952625 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:53.952640 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.953391 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.953396 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:53.953491 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:53.953951 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:53.953968 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:53.955914 (+ 1946us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:53.960672 (+ 4758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:53.960678 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:53.960682 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:53.960968 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:53.961351 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:53.961354 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:53.961356 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:53.961443 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:53.961953 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:53.961956 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:53.962063 (+ 107us) client_negotiation.cc:769] Sending connection context
0811 11:49:53.962164 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 11:49:53.962315 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105}
I20260811 11:49:53.963268 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.947429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33278 (local address 127.20.244.124:38163)
0811 11:49:53.948405 (+ 976us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:53.948451 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:53.948470 (+ 19us) server_negotiation.cc:407] Connection header received
0811 11:49:53.949444 (+ 974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:53.949451 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:53.949540 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:53.950236 (+ 696us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:53.950871 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.951629 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.952820 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.953213 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.953739 (+ 526us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:53.958480 (+ 4741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:53.958483 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:53.958486 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:53.958500 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:53.960536 (+ 2036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.961123 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.961129 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.961131 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.961216 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.961564 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.961570 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.961575 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.961796 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:53.961886 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:53.962908 (+ 1022us) server_negotiation.cc:299] Negotiation successful
0811 11:49:53.963028 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":878,"thread_start_us":86,"threads_started":1}
I20260811 11:49:53.966284 16573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.953469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.125:33439 (local address 127.0.0.1:43512)
0811 11:49:53.953936 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.953950 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:53.954027 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:53.956087 (+ 2060us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:53.956090 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:53.956280 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:53.956406 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:53.956415 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.957482 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.957485 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:53.958281 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:53.958294 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.958952 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.958957 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:53.959052 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:53.959550 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:53.959565 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:53.961433 (+ 1868us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:53.964014 (+ 2581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:53.964017 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:53.964019 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:53.964557 (+ 538us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:53.964920 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:53.964923 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:53.964926 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:53.965030 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:53.965693 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:53.965698 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:53.965814 (+ 116us) client_negotiation.cc:769] Sending connection context
0811 11:49:53.965937 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 11:49:53.966092 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379}
I20260811 11:49:53.966741 16483 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c2e2ee68ac14565bfe504539e300554: Bootstrap starting.
I20260811 11:49:53.966922 16487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.953740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43512 (local address 127.20.244.125:33439)
0811 11:49:53.953870 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:53.953875 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:53.954565 (+ 690us) server_negotiation.cc:407] Connection header received
0811 11:49:53.954616 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:53.954620 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:53.954671 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:53.954761 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:53.956569 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.957317 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.958416 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.958741 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.958837 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:53.961618 (+ 2781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:53.961623 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:53.961625 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:53.961653 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:53.963873 (+ 2220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.964693 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.964697 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.964699 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.964794 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.965162 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.965168 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.965169 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.965509 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:53.965634 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:53.966620 (+ 986us) server_negotiation.cc:299] Negotiation successful
0811 11:49:53.966744 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 11:49:53.967166 16399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.956506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56102 (local address 127.20.244.126:39213)
0811 11:49:53.956617 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:53.956623 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:53.956677 (+ 54us) server_negotiation.cc:407] Connection header received
0811 11:49:53.956813 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:53.956816 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:53.956866 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:53.956951 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:53.957573 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.958129 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.959222 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.959596 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.959684 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:53.963236 (+ 3552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:53.963240 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:53.963242 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:53.963271 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:53.964941 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.965444 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.965447 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.965449 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.965535 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.965870 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.965874 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.965876 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.966080 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:53.966224 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:53.966890 (+ 666us) server_negotiation.cc:299] Negotiation successful
0811 11:49:53.967006 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 11:49:53.967634 16570 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:49:53.969460 16397 raft_consensus.cc:348] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af7be10cc48a4adeaef731f3b68ba474" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39213 } } peers { permanent_uuid: "9c2e2ee68ac14565bfe504539e300554" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } } peers { permanent_uuid: "02d99aa123f34aa4be07395789effe4a" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } }
I20260811 11:49:53.969727 16397 raft_consensus.cc:729] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af7be10cc48a4adeaef731f3b68ba474, State: Initialized, Role: FOLLOWER
I20260811 11:49:53.970235 16397 consensus_queue.cc:260] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af7be10cc48a4adeaef731f3b68ba474" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39213 } } peers { permanent_uuid: "9c2e2ee68ac14565bfe504539e300554" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } } peers { permanent_uuid: "02d99aa123f34aa4be07395789effe4a" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } }
I20260811 11:49:53.970582 16483 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c2e2ee68ac14565bfe504539e300554: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:53.971567 16483 log.cc:824] T 00000000000000000000000000000000 P 9c2e2ee68ac14565bfe504539e300554: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:53.971750 16397 sys_catalog.cc:564] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:53.973901 16483 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c2e2ee68ac14565bfe504539e300554: No bootstrap required, opened a new log
Aug 11 11:49:53 dist-test-slave-vkjp krb5kdc[16303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448993, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.244.124@KRBTEST.COM for kudu/127.20.244.124@KRBTEST.COM
Aug 11 11:49:53 dist-test-slave-vkjp krb5kdc[16303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786448993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.244.125@KRBTEST.COM
I20260811 11:49:53.978634 16483 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c2e2ee68ac14565bfe504539e300554 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af7be10cc48a4adeaef731f3b68ba474" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39213 } } peers { permanent_uuid: "9c2e2ee68ac14565bfe504539e300554" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } } peers { permanent_uuid: "02d99aa123f34aa4be07395789effe4a" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } }
I20260811 11:49:53.978828 16573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.968163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.244.124:38163 (local address 127.0.0.1:33294)
0811 11:49:53.968328 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 11:49:53.968344 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:49:53.968423 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:49:53.969091 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:49:53.969094 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:49:53.969344 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:49:53.969447 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:53.969456 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.970692 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.970695 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:53.971454 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:49:53.971466 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.972129 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.972135 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:49:53.972208 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:53.972762 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:49:53.972779 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:49:53.974729 (+ 1950us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:49:53.976702 (+ 1973us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:53.976705 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:53.976707 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:53.977198 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:53.977771 (+ 573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:49:53.977774 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:49:53.977776 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:49:53.977864 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:49:53.978341 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:49:53.978344 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:49:53.978421 (+ 77us) client_negotiation.cc:769] Sending connection context
0811 11:49:53.978518 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 11:49:53.978662 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87}
I20260811 11:49:53.978897 16483 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c2e2ee68ac14565bfe504539e300554 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c2e2ee68ac14565bfe504539e300554, State: Initialized, Role: FOLLOWER
I20260811 11:49:53.979346 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.968703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33294 (local address 127.20.244.124:38163)
0811 11:49:53.968807 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:53.968811 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:53.968827 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:49:53.968862 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:53.968865 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:53.968908 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:53.968988 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:53.969602 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.970499 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.971582 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.971910 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.972018 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:53.974866 (+ 2848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:53.974870 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:53.974872 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:53.974893 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:53.976587 (+ 1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.977535 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.977539 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.977541 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.977626 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.977971 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.977976 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.977978 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.978199 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:53.978308 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:53.979047 (+ 739us) server_negotiation.cc:299] Negotiation successful
0811 11:49:53.979194 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 11:49:53.979668 16483 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c2e2ee68ac14565bfe504539e300554 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af7be10cc48a4adeaef731f3b68ba474" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39213 } } peers { permanent_uuid: "9c2e2ee68ac14565bfe504539e300554" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } } peers { permanent_uuid: "02d99aa123f34aa4be07395789effe4a" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } }
I20260811 11:49:53.981122 16483 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c2e2ee68ac14565bfe504539e300554 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 11:49:53.977843 16590 catalog_manager.cc:1558] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:49:53.981617 16590 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:49:53.979214 16578 sys_catalog.cc:455] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af7be10cc48a4adeaef731f3b68ba474" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39213 } } peers { permanent_uuid: "9c2e2ee68ac14565bfe504539e300554" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } } peers { permanent_uuid: "02d99aa123f34aa4be07395789effe4a" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } } }
I20260811 11:49:53.983067 16570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02d99aa123f34aa4be07395789effe4a: Bootstrap starting.
I20260811 11:49:53.983160 16578 sys_catalog.cc:458] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:49:53.984727 16487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.969265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43516 (local address 127.20.244.125:33439)
0811 11:49:53.969436 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:53.969439 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:53.969501 (+ 62us) server_negotiation.cc:407] Connection header received
0811 11:49:53.969851 (+ 350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:53.969854 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:53.969900 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:53.970038 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:53.971144 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.971943 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.973077 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:53.973381 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:53.973457 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:53.976541 (+ 3084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:53.976545 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:53.976548 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:53.976574 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:53.978138 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.978628 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.978632 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.978634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.979371 (+ 737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:53.983660 (+ 4289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:53.983664 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:53.983666 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:53.983889 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:53.984038 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:53.984429 (+ 391us) server_negotiation.cc:299] Negotiation successful
0811 11:49:53.984566 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 11:49:53.982255 16318 master_runner.cc:186] Error getting master registration for 127.20.244.125:33439: OK, instance_id { permanent_uuid: "9c2e2ee68ac14565bfe504539e300554" instance_seqno: 1786448993693005 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 11:49:53.986110 16318 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 11:49:53.986379 16570 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 02d99aa123f34aa4be07395789effe4a: Neither blocks nor log segments found. Creating new log.
I20260811 11:49:53.987366 16570 log.cc:824] T 00000000000000000000000000000000 P 02d99aa123f34aa4be07395789effe4a: Log is configured to *not* fsync() on all Append() calls
I20260811 11:49:53.990697 21457 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:49:53.991276 16593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c2e2ee68ac14565bfe504539e300554 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af7be10cc48a4adeaef731f3b68ba474" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39213 } } peers { permanent_uuid: "9c2e2ee68ac14565bfe504539e300554" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } } peers { permanent_uuid: "02d99aa123f34aa4be07395789effe4a" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } } }
I20260811 11:49:53.991429 16593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c2e2ee68ac14565bfe504539e300554 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 11:49:53.991845 16608 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9c2e2ee68ac14565bfe504539e300554: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:49:53.992022 16608 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:49:53.992369 16369 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "af7be10cc48a4adeaef731f3b68ba474"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56102
I20260811 11:49:53.992628 16369 raft_consensus.cc:482] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 11:49:53.992751 16369 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:53.994236 16369 raft_consensus.cc:504] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af7be10cc48a4adeaef731f3b68ba474" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39213 } } peers { permanent_uuid: "9c2e2ee68ac14565bfe504539e300554" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } } peers { permanent_uuid: "02d99aa123f34aa4be07395789effe4a" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } }
I20260811 11:49:53.990622 16404 master_runner.cc:186] Error getting master registration for 127.20.244.124:38163: OK, instance_id { permanent_uuid: "02d99aa123f34aa4be07395789effe4a" instance_seqno: 1786448993927763 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 11:49:53.994803 16404 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 11:49:53.995615 16369 leader_election.cc:288] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474 [CANDIDATE]: Term 1 election: Requested vote from peers 9c2e2ee68ac14565bfe504539e300554 (127.20.244.125:33439), 02d99aa123f34aa4be07395789effe4a (127.20.244.124:38163)
I20260811 11:49:53.996076 16451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "af7be10cc48a4adeaef731f3b68ba474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "9c2e2ee68ac14565bfe504539e300554"
I20260811 11:49:53.996279 16451 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c2e2ee68ac14565bfe504539e300554 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:53.997458 16451 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9c2e2ee68ac14565bfe504539e300554 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af7be10cc48a4adeaef731f3b68ba474 in term 1.
I20260811 11:49:53.998064 16338 leader_election.cc:302] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c2e2ee68ac14565bfe504539e300554, af7be10cc48a4adeaef731f3b68ba474; no voters:
I20260811 11:49:53.998407 16578 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:49:53.998633 16578 raft_consensus.cc:686] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474 [term 1 LEADER]: Becoming Leader. State: Replica: af7be10cc48a4adeaef731f3b68ba474, State: Running, Role: LEADER
I20260811 11:49:53.999051 16578 consensus_queue.cc:237] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af7be10cc48a4adeaef731f3b68ba474" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39213 } } peers { permanent_uuid: "9c2e2ee68ac14565bfe504539e300554" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } } peers { permanent_uuid: "02d99aa123f34aa4be07395789effe4a" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } }
I20260811 11:49:54.000090 16570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02d99aa123f34aa4be07395789effe4a: No bootstrap required, opened a new log
I20260811 11:49:54.001756 16616 sys_catalog.cc:455] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af7be10cc48a4adeaef731f3b68ba474. Latest consensus state: current_term: 1 leader_uuid: "af7be10cc48a4adeaef731f3b68ba474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af7be10cc48a4adeaef731f3b68ba474" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39213 } } peers { permanent_uuid: "9c2e2ee68ac14565bfe504539e300554" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } } peers { permanent_uuid: "02d99aa123f34aa4be07395789effe4a" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } } }
I20260811 11:49:54.002058 16616 sys_catalog.cc:458] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:54.005831 16570 raft_consensus.cc:348] T 00000000000000000000000000000000 P 02d99aa123f34aa4be07395789effe4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af7be10cc48a4adeaef731f3b68ba474" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39213 } } peers { permanent_uuid: "9c2e2ee68ac14565bfe504539e300554" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } } peers { permanent_uuid: "02d99aa123f34aa4be07395789effe4a" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } }
I20260811 11:49:54.006145 16570 raft_consensus.cc:729] T 00000000000000000000000000000000 P 02d99aa123f34aa4be07395789effe4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02d99aa123f34aa4be07395789effe4a, State: Initialized, Role: FOLLOWER
I20260811 11:49:54.006538 16570 consensus_queue.cc:260] T 00000000000000000000000000000000 P 02d99aa123f34aa4be07395789effe4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af7be10cc48a4adeaef731f3b68ba474" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39213 } } peers { permanent_uuid: "9c2e2ee68ac14565bfe504539e300554" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } } peers { permanent_uuid: "02d99aa123f34aa4be07395789effe4a" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } }
I20260811 11:49:54.008126 16570 sys_catalog.cc:564] T 00000000000000000000000000000000 P 02d99aa123f34aa4be07395789effe4a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:49:54.008222 16540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "af7be10cc48a4adeaef731f3b68ba474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "02d99aa123f34aa4be07395789effe4a"
I20260811 11:49:54.008489 16540 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 02d99aa123f34aa4be07395789effe4a [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:49:54.009887 16540 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 02d99aa123f34aa4be07395789effe4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af7be10cc48a4adeaef731f3b68ba474 in term 1.
I20260811 11:49:54.017346 16619 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:49:54.018702 16619 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:49:54.018893 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:53.997875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33296 (local address 127.20.244.124:38163)
0811 11:49:53.998069 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:53.998081 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:54.004745 (+ 6664us) server_negotiation.cc:407] Connection header received
0811 11:49:54.005045 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:54.005049 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:54.005111 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:54.005173 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:54.006866 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:54.007623 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:54.011513 (+ 3890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:54.011900 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:54.011979 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:54.013965 (+ 1986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:54.013970 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:54.013973 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:54.014001 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:54.016864 (+ 2863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:54.017414 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:54.017421 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:54.017423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:54.017527 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:54.017857 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:54.017863 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:54.017865 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:54.018081 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:54.018202 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:54.018603 (+ 401us) server_negotiation.cc:299] Negotiation successful
0811 11:49:54.018737 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260811 11:49:54.020855 16633 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 02d99aa123f34aa4be07395789effe4a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:49:54.020942 16633 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:49:54.025892 16540 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 02d99aa123f34aa4be07395789effe4a [term 1 FOLLOWER]: Refusing update from remote peer af7be10cc48a4adeaef731f3b68ba474: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:49:54.026670 16616 consensus_queue.cc:1035] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d99aa123f34aa4be07395789effe4a" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:49:54.029239 16399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:54.003564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56112 (local address 127.20.244.126:39213)
0811 11:49:54.003691 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:54.003696 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:54.008907 (+ 5211us) server_negotiation.cc:407] Connection header received
0811 11:49:54.016508 (+ 7601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:54.016511 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:54.016617 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:54.016741 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:54.020539 (+ 3798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:54.021349 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:54.022230 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:54.022599 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:54.022705 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:54.024916 (+ 2211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:54.024921 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:54.024925 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:54.024960 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:54.027206 (+ 2246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:54.027750 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:54.027755 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:54.027757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:54.027854 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:54.028178 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:54.028182 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:54.028184 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:54.028431 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:54.028555 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:54.028926 (+ 371us) server_negotiation.cc:299] Negotiation successful
0811 11:49:54.029063 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 11:49:54.032923 16451 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9c2e2ee68ac14565bfe504539e300554 [term 1 FOLLOWER]: Refusing update from remote peer af7be10cc48a4adeaef731f3b68ba474: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:49:54.033615 16616 consensus_queue.cc:1035] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c2e2ee68ac14565bfe504539e300554" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:49:54.034040 16578 sys_catalog.cc:455] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "af7be10cc48a4adeaef731f3b68ba474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af7be10cc48a4adeaef731f3b68ba474" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39213 } } peers { permanent_uuid: "9c2e2ee68ac14565bfe504539e300554" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } } peers { permanent_uuid: "02d99aa123f34aa4be07395789effe4a" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } } }
I20260811 11:49:54.034181 16578 sys_catalog.cc:458] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:54.037745 16622 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02d99aa123f34aa4be07395789effe4a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af7be10cc48a4adeaef731f3b68ba474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af7be10cc48a4adeaef731f3b68ba474" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39213 } } peers { permanent_uuid: "9c2e2ee68ac14565bfe504539e300554" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } } peers { permanent_uuid: "02d99aa123f34aa4be07395789effe4a" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } } }
I20260811 11:49:54.037894 16622 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02d99aa123f34aa4be07395789effe4a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:49:54.037968 16622 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02d99aa123f34aa4be07395789effe4a [sys.catalog]: SysCatalogTable state changed. Reason: New leader af7be10cc48a4adeaef731f3b68ba474. Latest consensus state: current_term: 1 leader_uuid: "af7be10cc48a4adeaef731f3b68ba474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af7be10cc48a4adeaef731f3b68ba474" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39213 } } peers { permanent_uuid: "9c2e2ee68ac14565bfe504539e300554" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } } peers { permanent_uuid: "02d99aa123f34aa4be07395789effe4a" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } } }
I20260811 11:49:54.038028 16622 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02d99aa123f34aa4be07395789effe4a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:49:54.038080 16622 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02d99aa123f34aa4be07395789effe4a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "af7be10cc48a4adeaef731f3b68ba474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af7be10cc48a4adeaef731f3b68ba474" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39213 } } peers { permanent_uuid: "9c2e2ee68ac14565bfe504539e300554" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } } peers { permanent_uuid: "02d99aa123f34aa4be07395789effe4a" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } } }
I20260811 11:49:54.038128 16622 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02d99aa123f34aa4be07395789effe4a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:49:54.039332 16637 mvcc.cc:205] Tried to move back new op lower bound from 7317295079523155968 to 7317295079423791104. Current Snapshot: MvccSnapshot[applied={T|T < 7317295079523155968}]
I20260811 11:49:54.039587 16593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c2e2ee68ac14565bfe504539e300554 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af7be10cc48a4adeaef731f3b68ba474. Latest consensus state: current_term: 1 leader_uuid: "af7be10cc48a4adeaef731f3b68ba474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af7be10cc48a4adeaef731f3b68ba474" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39213 } } peers { permanent_uuid: "9c2e2ee68ac14565bfe504539e300554" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } } peers { permanent_uuid: "02d99aa123f34aa4be07395789effe4a" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } } }
I20260811 11:49:54.039705 16593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c2e2ee68ac14565bfe504539e300554 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:49:54.039796 16593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c2e2ee68ac14565bfe504539e300554 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "af7be10cc48a4adeaef731f3b68ba474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af7be10cc48a4adeaef731f3b68ba474" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39213 } } peers { permanent_uuid: "9c2e2ee68ac14565bfe504539e300554" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } } peers { permanent_uuid: "02d99aa123f34aa4be07395789effe4a" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } } }
I20260811 11:49:54.039880 16593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c2e2ee68ac14565bfe504539e300554 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:49:54.041527 16487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:54.004073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43518 (local address 127.20.244.125:33439)
0811 11:49:54.004202 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:54.004207 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:54.020427 (+ 16220us) server_negotiation.cc:407] Connection header received
0811 11:49:54.022709 (+ 2282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:54.022712 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:54.022767 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:54.022819 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:54.023799 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:54.024496 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:54.025930 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:54.026264 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:54.026352 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:54.030084 (+ 3732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:49:54.030089 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:49:54.030092 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:49:54.030125 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:49:54.032018 (+ 1893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:54.038943 (+ 6925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:54.038959 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:54.038961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:54.039116 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:49:54.040408 (+ 1292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:49:54.040412 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:49:54.040414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:49:54.040673 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:49:54.040799 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:54.041218 (+ 419us) server_negotiation.cc:299] Negotiation successful
0811 11:49:54.041359 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 11:49:54.043623 16643 mvcc.cc:205] Tried to move back new op lower bound from 7317295079523155968 to 7317295079423791104. Current Snapshot: MvccSnapshot[applied={T|T < 7317295079523155968}]
I20260811 11:49:54.053035 16619 catalog_manager.cc:1347] Generated new cluster ID: bcf222f181214c4eb1c342f05de80446
I20260811 11:49:54.053131 16619 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:49:54.061439 16639 mvcc.cc:205] Tried to move back new op lower bound from 7317295079523155968 to 7317295079423791104. Current Snapshot: MvccSnapshot[applied={T|T < 7317295079523155968}]
I20260811 11:49:54.071269 16616 sys_catalog.cc:455] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "af7be10cc48a4adeaef731f3b68ba474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af7be10cc48a4adeaef731f3b68ba474" member_type: VOTER last_known_addr { host: "127.20.244.126" port: 39213 } } peers { permanent_uuid: "9c2e2ee68ac14565bfe504539e300554" member_type: VOTER last_known_addr { host: "127.20.244.125" port: 33439 } } peers { permanent_uuid: "02d99aa123f34aa4be07395789effe4a" member_type: VOTER last_known_addr { host: "127.20.244.124" port: 38163 } } }
I20260811 11:49:54.071408 16616 sys_catalog.cc:458] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474 [sys.catalog]: This master's current role is: LEADER
I20260811 11:49:54.075377 16619 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:49:54.076793 16619 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:49:54.088879 16619 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af7be10cc48a4adeaef731f3b68ba474: Generated new TSK 0
I20260811 11:49:54.089849 16619 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 11:49:54.120045 16576 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:54.117426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33298 (local address 127.20.244.124:38163)
0811 11:49:54.117569 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:54.117575 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:54.118780 (+ 1205us) server_negotiation.cc:407] Connection header received
0811 11:49:54.118986 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:54.118989 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:54.119039 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:54.119146 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:54.119896 (+ 750us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33298: BlockingRecv error: recv got EOF from 127.0.0.1:33298 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260811 11:49:54.120659 16399 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:54.118174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56118 (local address 127.20.244.126:39213)
0811 11:49:54.118323 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:54.118328 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:54.119566 (+ 1238us) server_negotiation.cc:407] Connection header received
0811 11:49:54.119764 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:54.119768 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:54.119824 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:54.119882 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:54.120508 (+ 626us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56118: BlockingRecv error: recv got EOF from 127.0.0.1:56118 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260811 11:49:54.121869 16487 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:54.118864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43524 (local address 127.20.244.125:33439)
0811 11:49:54.118989 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:54.118994 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:54.120813 (+ 1819us) server_negotiation.cc:407] Connection header received
0811 11:49:54.121123 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:54.121126 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:54.121179 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:54.121231 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:54.121750 (+ 519us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43524: BlockingRecv error: recv got EOF from 127.0.0.1:43524 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260811 11:49:54.129400 16487 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:54.127507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43536 (local address 127.20.244.125:33439)
0811 11:49:54.127630 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:54.127634 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:54.128136 (+ 502us) server_negotiation.cc:407] Connection header received
0811 11:49:54.128442 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:54.128447 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:54.128535 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:54.128598 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:54.129193 (+ 595us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43536: BlockingRecv error: recv got EOF from 127.0.0.1:43536 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260811 11:49:54.135070 16487 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:54.133353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43544 (local address 127.20.244.125:33439)
0811 11:49:54.133467 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:54.133472 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:54.134028 (+ 556us) server_negotiation.cc:407] Connection header received
0811 11:49:54.134232 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:54.134237 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:54.134310 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:54.134369 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:54.134953 (+ 584us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43544: BlockingRecv error: recv got EOF from 127.0.0.1:43544 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260811 11:49:54.141552 16487 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:54.139731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43560 (local address 127.20.244.125:33439)
0811 11:49:54.139852 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:54.139857 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:54.140430 (+ 573us) server_negotiation.cc:407] Connection header received
0811 11:49:54.140664 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:54.140668 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:54.140725 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:54.140782 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:54.141427 (+ 645us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43560: BlockingRecv error: recv got EOF from 127.0.0.1:43560 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260811 11:49:54.150971 16487 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:54.149008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43572 (local address 127.20.244.125:33439)
0811 11:49:54.149180 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:54.149186 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:54.149843 (+ 657us) server_negotiation.cc:407] Connection header received
0811 11:49:54.150079 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:54.150083 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:54.150143 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:54.150203 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:54.150848 (+ 645us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43572: BlockingRecv error: recv got EOF from 127.0.0.1:43572 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
W20260811 11:49:54.164244 16487 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:54.162223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43584 (local address 127.20.244.125:33439)
0811 11:49:54.162373 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:54.162378 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:54.163025 (+ 647us) server_negotiation.cc:407] Connection header received
0811 11:49:54.163302 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:54.163307 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:54.163375 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:54.163440 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:54.164114 (+ 674us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43584: BlockingRecv error: recv got EOF from 127.0.0.1:43584 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260811 11:49:54.185846 16487 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:54.183639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43588 (local address 127.20.244.125:33439)
0811 11:49:54.183787 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:54.183793 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:54.184570 (+ 777us) server_negotiation.cc:407] Connection header received
0811 11:49:54.184835 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:54.184839 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:54.184906 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:54.184975 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:54.185712 (+ 737us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43588: BlockingRecv error: recv got EOF from 127.0.0.1:43588 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260811 11:49:54.222571 16487 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:54.221058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43596 (local address 127.20.244.125:33439)
0811 11:49:54.221207 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:54.221212 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:54.221527 (+ 315us) server_negotiation.cc:407] Connection header received
0811 11:49:54.221730 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:54.221734 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:54.221790 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:54.221901 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:54.222423 (+ 522us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43596: BlockingRecv error: recv got EOF from 127.0.0.1:43596 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260811 11:49:54.290805 16487 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:54.289265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43608 (local address 127.20.244.125:33439)
0811 11:49:54.289434 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:54.289439 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:54.289768 (+ 329us) server_negotiation.cc:407] Connection header received
0811 11:49:54.289988 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:54.289991 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:54.290042 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:54.290139 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:54.290652 (+ 513us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43608: BlockingRecv error: recv got EOF from 127.0.0.1:43608 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260811 11:49:54.422679 16487 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:54.421423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43620 (local address 127.20.244.125:33439)
0811 11:49:54.421587 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:54.421592 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:54.421719 (+ 127us) server_negotiation.cc:407] Connection header received
0811 11:49:54.421901 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:54.421904 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:54.421979 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:54.422075 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:54.422553 (+ 478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43620: BlockingRecv error: recv got EOF from 127.0.0.1:43620 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260811 11:49:54.682560 16487 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:49:54.681204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43622 (local address 127.20.244.125:33439)
0811 11:49:54.681362 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:54.681367 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:54.681520 (+ 153us) server_negotiation.cc:407] Connection header received
0811 11:49:54.681712 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:54.681720 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:54.681770 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:54.681862 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:49:54.682408 (+ 546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43622: BlockingRecv error: recv got EOF from 127.0.0.1:43622 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 11:49:54.993527 16608 catalog_manager.cc:1259] Loaded cluster ID: bcf222f181214c4eb1c342f05de80446
I20260811 11:49:54.993621 16608 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9c2e2ee68ac14565bfe504539e300554: loading cluster ID for follower catalog manager: success
I20260811 11:49:54.995620 16608 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9c2e2ee68ac14565bfe504539e300554: acquiring CA information for follower catalog manager: success
I20260811 11:49:54.996806 16608 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9c2e2ee68ac14565bfe504539e300554: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 11:49:55.022392 16633 catalog_manager.cc:1259] Loaded cluster ID: bcf222f181214c4eb1c342f05de80446
I20260811 11:49:55.022511 16633 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 02d99aa123f34aa4be07395789effe4a: loading cluster ID for follower catalog manager: success
I20260811 11:49:55.024255 16633 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 02d99aa123f34aa4be07395789effe4a: acquiring CA information for follower catalog manager: success
I20260811 11:49:55.025456 16633 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 02d99aa123f34aa4be07395789effe4a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 11:49:55.201120 16725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:55.196913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43628 (local address 127.20.244.125:33439)
0811 11:49:55.197197 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:55.197201 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:55.197219 (+ 18us) server_negotiation.cc:407] Connection header received
0811 11:49:55.197376 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:55.197379 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:55.197521 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:55.197636 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:49:55.197899 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:55.198477 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:55.199572 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:55.199849 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:55.199950 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:55.200246 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:49:55.200732 (+ 486us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:49:55.200866 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:55.200895 (+ 29us) server_negotiation.cc:299] Negotiation successful
0811 11:49:55.200968 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":121,"threads_started":1}
I20260811 11:49:55.208519 16731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:55.204590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33314 (local address 127.20.244.124:38163)
0811 11:49:55.204849 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:55.204855 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:55.204873 (+ 18us) server_negotiation.cc:407] Connection header received
0811 11:49:55.204983 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:55.204986 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:55.205108 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:55.205237 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:49:55.205487 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:55.205996 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:55.206854 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:55.207127 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:55.207240 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:55.207576 (+ 336us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:49:55.208076 (+ 500us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:49:55.208210 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:55.208252 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 11:49:55.208310 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":73,"threads_started":1}
I20260811 11:49:55.216565 16740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:55.211993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56120 (local address 127.20.244.126:39213)
0811 11:49:55.212574 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:55.212580 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:55.212596 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:49:55.212688 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:55.212691 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:55.212833 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:55.212967 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:49:55.213264 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:55.214097 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:55.215069 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:55.215345 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:55.215456 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:55.215784 (+ 328us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:49:55.216074 (+ 290us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:49:55.216183 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:55.216301 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 11:49:55.216362 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":497,"thread_start_us":77,"threads_started":1}
I20260811 11:49:55.216956 16731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:55.212017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33324 (local address 127.20.244.124:38163)
0811 11:49:55.212126 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:55.212130 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:55.212395 (+ 265us) server_negotiation.cc:407] Connection header received
0811 11:49:55.213237 (+ 842us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:55.213243 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:55.213310 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:55.213380 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:49:55.213627 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:55.214129 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:55.215515 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:55.215851 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:55.215929 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:55.216464 (+ 535us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:49:55.216543 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:49:55.216592 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:55.216771 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 11:49:55.216826 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 11:49:55.216956 16725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:49:55.212360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43642 (local address 127.20.244.125:33439)
0811 11:49:55.212481 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 11:49:55.212490 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:49:55.212744 (+ 254us) server_negotiation.cc:407] Connection header received
0811 11:49:55.212867 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:49:55.212870 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:49:55.212928 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:49:55.213012 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:49:55.213321 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:55.214091 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:55.215523 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:49:55.215860 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:49:55.215931 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:49:55.216475 (+ 544us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:49:55.216544 (+ 69us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:49:55.216592 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 11:49:55.216771 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 11:49:55.216827 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 11:49:55.224502 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 16318
I20260811 11:49:55.236227 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 16404
I20260811 11:49:55.245185 21457 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVpoijE/build/debug/bin/kudu with pid 16491
2026-08-11T11:49:55Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3285 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6696 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (298518 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST